Detail publikace

New Benchmark Functions for Single-Objective Optimization Based on a Zigzag Pattern

KŮDELA, J. MATOUŠEK, R.

Anglický název

New Benchmark Functions for Single-Objective Optimization Based on a Zigzag Pattern

Typ

článek v časopise ve Web of Science, Jimp

Jazyk

en

Originální abstrakt

Benchmarking plays a crucial role in both development of new optimization methods, and in conducting proper comparisons between already existing methods, particularly in the field of evolutionary computation. In this paper, we develop new benchmark functions for bound-constrained single-objective optimization that are based on a zigzag function. The proposed zigzag function has three parameters that control its behaviour and difficulty of the resulting problems. Utilizing the zigzag function, we introduce four new functions and conduct extensive computational experiments to evaluate their performance as benchmarks. The experiments comprise of using the newly proposed functions in 100 different parameter settings for the comparison of eight different optimization algorithms, which are a mix of canonical methods and best performing methods from the Congress on Evolutionary Computation competitions. Using the results from the computational comparison, we choose some of the parametrization of the newly proposed functions to devise an ambiguous benchmark set in which each of the problems introduces a statistically significant ranking among the algorithms, but the ranking for the entire set is ambiguous with no clear dominating relationship between the algorithms. We also conduct an exploratory landscape analysis of the newly proposed benchmark functions and compare the results with the benchmark functions used in the Black-Box-Optimization-Benchmarking suite. The results suggest that the new benchmark functions are well suited for algorithmic comparisons.

Anglický abstrakt

Benchmarking plays a crucial role in both development of new optimization methods, and in conducting proper comparisons between already existing methods, particularly in the field of evolutionary computation. In this paper, we develop new benchmark functions for bound-constrained single-objective optimization that are based on a zigzag function. The proposed zigzag function has three parameters that control its behaviour and difficulty of the resulting problems. Utilizing the zigzag function, we introduce four new functions and conduct extensive computational experiments to evaluate their performance as benchmarks. The experiments comprise of using the newly proposed functions in 100 different parameter settings for the comparison of eight different optimization algorithms, which are a mix of canonical methods and best performing methods from the Congress on Evolutionary Computation competitions. Using the results from the computational comparison, we choose some of the parametrization of the newly proposed functions to devise an ambiguous benchmark set in which each of the problems introduces a statistically significant ranking among the algorithms, but the ranking for the entire set is ambiguous with no clear dominating relationship between the algorithms. We also conduct an exploratory landscape analysis of the newly proposed benchmark functions and compare the results with the benchmark functions used in the Black-Box-Optimization-Benchmarking suite. The results suggest that the new benchmark functions are well suited for algorithmic comparisons.

Klíčová slova anglicky

numerical optimization; benchmarking; single objective problems; exploratory landscape analysis

Vydáno

20.01.2022

Nakladatel

IEEE

ISSN

2169-3536

Ročník

10

Číslo

1

Strany od–do

8262–8278

Počet stran

17

BIBTEX


@article{BUT176022,
  author="Jakub {Kůdela} and Radomil {Matoušek},
  title="New Benchmark Functions for Single-Objective Optimization Based on a Zigzag Pattern",
  year="2022",
  volume="10",
  number="1",
  month="January",
  pages="8262--8278",
  publisher="IEEE",
  issn="2169-3536"
}