Evolving artificial neural networks with generative encodings inspired by developmental biology

作者: Charles Ofria , Jeff Clune , Robert T. Pennock

DOI:

关键词: Computer scienceArtificial neural networkProperty (programming)Artificial intelligenceEncoding (memory)Evolutionary algorithmGenerative grammarModularityGenerative DesignDomain knowledge

摘要: In this dissertation I investigate the difference between generative encodings and direct for evolutionary algorithms. Generative are inspired by developmental biology were designed, in part, to increase regularity of synthetically evolved phenotypes. Regularity is an important design principle both natural organisms engineered designs. The majority focuses on how property enables a encoding outperform controls, whether bias towards also hurts performance some problems. report researchers can types regularities produced accommodate user preferences. Finally, study degree which produces another principle, modularity. Several previous studies have shown that highly regular However, prior dissertation, it was not known compare problems with different levels regularity. On three problems, show exploit intermediate amounts problem regularity, enabled increasingly controls as increased. This gap emerged because artificial neural networks (ANNs) behaviors. ANNs contained diverse array complicated, wiring patterns, whereas control irregular. I document hurt amount irregularity. propose new algorithm, called HybrID, wherein patterns modifies those provide fitness-enhancing irregularities. HybrID outperformed alone nearly all raises question may ultimately excel stand-alone algorithms, but being hybridized further process irregular refinement. The results described so far produce solutions. then that, at least case study, possible influence produced, allows domain knowledge preferences be injected into algorithm. investigated modular present first documented producing phenotype simple problem. encoding's inability create modularity harder where would been beneficial suggests more work needed likelihood response challenging, decomposable Overall, paints complete picture than studies. general conclusion drawn from properties seen complex, organisms, will likely part our long-term goal evolving phenotypes approach capability, intelligence, complexity their rivals.

参考文章(43)
Krister Wolff, Peter Nordin, An evolutionary based approach for control programming of humanoids ieee ras international conference on humanoid robots. ,(2003)
Jason Gauci, Kenneth O. Stanley, A case study on the critical role of geometric regularity in machine learning national conference on artificial intelligence. pp. 628- 633 ,(2008)
Ricardo A. Téllez, Cecilio Angulo, Diego E. Pardo, Evolving the walking behaviour of a 12 DOF quadruped using a distributed neural architecture Lecture Notes in Computer Science. pp. 5- 19 ,(2006) , 10.1007/11613022_4
Frederic Gruau, Darrell Whitley, Larry Pyeatt, None, A comparison between cellular encoding and direct encoding for genetic neural networks Proceedings of the 1st annual conference on genetic programming. pp. 81- 89 ,(1996)
Jeff Clune, Charles Ofria, Robert T. Pennock, How a Generative Encoding Fares as Problem-Regularity Decreases parallel problem solving from nature. pp. 358- 367 ,(2008) , 10.1007/978-3-540-87700-4_36
Chris Adami, Alan N. Hampton, Evolution of Robust Developmental Neural Networks arXiv: Adaptation and Self-Organizing Systems. ,(2004)
Leland H. Hartwell, John J. Hopfield, Stanislas Leibler, Andrew W. Murray, From molecular to modular cell biology. Nature. ,vol. 402, ,(1999) , 10.1038/35011540
Jeff Clune, Benjamin E. Beckmann, Robert T. Pennock, Charles Ofria, HybrID: a hybridization of indirect and direct encodings for evolutionary computation european conference on artificial life. pp. 134- 141 ,(2009) , 10.1007/978-3-642-21314-4_17