Bernoulli's principle of insufficient reason and conservation of information in computer search

作者: William A. Dembski , Robert J. Marks

DOI: 10.1109/ICSMC.2009.5346119

关键词: No free lunch theoremTheoretical computer scienceEntropy (information theory)Computer searchArtificial intelligenceSearch algorithmMathematicsBernoulli's principleIncremental heuristic searchBlack hole information paradoxPrinciple of indifference

摘要: Conservation of information (COI) popularized by the no free lunch theorem is a great leveler search algorithms, showing that on average outperforms any other. Yet in practice some searches appear to outperform others. In consequence, have questioned significance COI performance algorithms. An underlying foundation Bernoulli's Principle Insufficient Reason1(PrOIR) which imposes uniform distribution space absence all prior knowledge about target or structure. The assumption conserved under mapping. If probability finding p, then problem subset p. More generally, some-to-many mappings result new where chance doing better than p 50–50. Consequently worse This can be viewed as confirming property COI. To properly assess for search, one must completely identify precise sources affect performance. discussion leads resolution seeming conflict between and observation algorithms perform well large class problems.

参考文章(64)
David H. Wolpert, Original Contribution: Stacked generalization Neural Networks. ,vol. 5, pp. 241- 259 ,(1992) , 10.1016/S0893-6080(05)80023-1
Dominik Gwiazda Tomasz, Genetic Algorithms Reference ,(2006)
William A. Dembski, , Robert J. Marks II, , The Search for a Search: Measuring the Information Cost of Higher Level Search Journal of Advanced Computational Intelligence and Intelligent Informatics. ,vol. 14, pp. 475- 486 ,(2010) , 10.20965/JACIII.2010.P0475
David H. Wolpert, On the Connection between In-sample Testing and Generalization Error. Complex Systems. ,vol. 6, ,(1992)
John M. Vickers, Probability and Utility Springer, Dordrecht. pp. 109- 127 ,(1993) , 10.1007/978-94-015-8208-7_6
Thomas M. English, Evaluation of Evolutionary and Genetic Optimizers: No Free Lunch. Evolutionary Programming. pp. 163- 169 ,(1996)
J. P. Burg, Maximum entropy spectral analysis Proc. the 37th Meeting of the Society of Exploration Geophysicists. ,(1967)