Regarding the rankings of optimization heuristics based on artificially-constructed benchmark functions

作者: Adam P. Piotrowski

DOI: 10.1016/J.INS.2014.11.023

关键词:

摘要: Novel Evolutionary Algorithms are usually tested on sets of artificially-constructed benchmark problems. Such problems often created to make the search one global extremum (usually minimum) tricky. In this paper it is shown that benchmarking heuristics either minimization or maximization same set artificially-created functions (with equal bounds and number allowed function calls) may lead very different ranking algorithms. As other heuristic optimizers developed in order be applicable real-world problems, such result raise doubts practical meaning them artificial functions, as there little reason searching for minimum should more important than their maximum.Thirty optimization heuristics, including a variants Differential Evolution, well kinds Algorithms, Particle Swarm Optimization, Direct Search methods - following idea borrowed from No Free Lunch pure random paper. Some discussion regarding choice mean median performance comparison addressed short debate overall particular given.

参考文章(81)
B. Bergmann, G. Hommel, Improvements of General Multiple Test Procedures for Redundant Systems of Hypotheses Springer, Berlin, Heidelberg. pp. 100- 115 ,(1988) , 10.1007/978-3-642-52307-6_8
Maurice Clerc, Particle Swarm Optimization ,(2006)
David H. Wolpert, William G. Macready, No Free Lunch Theorems for Search Research Papers in Economics. ,(1995)
Janez Demšar, Statistical Comparisons of Classifiers over Multiple Data Sets Journal of Machine Learning Research. ,vol. 7, pp. 1- 30 ,(2006)
Rainer Storn, Kenneth Price, Differential Evolution – A Simple and Efficient Heuristic for Global Optimization over Continuous Spaces Journal of Global Optimization. ,vol. 11, pp. 341- 359 ,(1997) , 10.1023/A:1008202821328
Christian Igel, Marc Toussaint, On classes of functions for which No Free Lunch results hold Information Processing Letters. ,vol. 86, pp. 317- 321 ,(2003) , 10.1016/S0020-0190(03)00222-9
Milton Friedman, The Use of Ranks to Avoid the Assumption of Normality Implicit in the Analysis of Variance Journal of the American Statistical Association. ,vol. 32, pp. 675- 701 ,(1937) , 10.2307/2279372
J. Sun, J. M. Garibaldi, N. Krasnogor, Q. Zhang, An intelligent multi-restart memetic algorithm for box constrained global optimisation Evolutionary Computation. ,vol. 21, pp. 107- 147 ,(2013) , 10.1162/EVCO_A_00068
Wenyin Gong, Álvaro Fialho, Zhihua Cai, Hui Li, Adaptive strategy selection in differential evolution for numerical optimization: An empirical study Information Sciences. ,vol. 181, pp. 5364- 5386 ,(2011) , 10.1016/J.INS.2011.07.049