Evolving Neural Network Agents in the NERO Video Game

作者: Kenneth O. Stanley and Bobby D. Bryant and Risto Miikkulainen

DOI:

关键词:

摘要: In most modern video games, character be- havior is scripted; no matter how many times the player exploits a weakness, that weakness never repaired. Yet if game characters could learn through interacting with player, behavior improve during game- play, keeping it interesting. This paper introduces real-time NeuroEvolution of Augmenting Topologies (rt- NEAT) method for evolving increasingly complex arti- ficial neural networks in real time, as being played. The rtNEAT allows agents to change and game. fact, makes possible new genre games which teaches team series customized training exercises. order demonstrate this concept NeuroEvolving Robotic Operatives (NERO) game, trains robots combat. describes results from novel application machine learning, also demonstrates multiple can evolve adapt like NERO time using rtNEAT. future, may allow kinds educational applications online user gains skills.

参考文章(16)
Frederic Gruau, Darrell Whitley, Larry Pyeatt, None, A comparison between cellular encoding and direct encoding for genetic neural networks Proceedings of the 1st annual conference on genetic programming. pp. 81- 89 ,(1996)
Hans-Georg Beyer, Hans-Paul Schwefel, Evolution strategies –A comprehensive introduction Natural Computing. ,vol. 1, pp. 3- 52 ,(2002) , 10.1023/A:1015059928466
David E. Rumelhart, James L. McClelland, , Parallel distributed processing: explorations in the microstructure of cognition, vol. 1: foundations Computational Models of Cognition and Perception. ,(1986) , 10.7551/MITPRESS/5236.001.0001
L. P. Kaelbling, M. L. Littman, A. W. Moore, Reinforcement learning: a survey Journal of Artificial Intelligence Research. ,vol. 4, pp. 237- 285 ,(1996) , 10.1613/JAIR.301
Kenneth O. Stanley, Risto Miikkulainen, Evolving neural networks through augmenting topologies Evolutionary Computation. ,vol. 10, pp. 99- 127 ,(2002) , 10.1162/106365602320169811
Paul E. Utgoff, Incremental Induction of Decision Trees Machine Learning. ,vol. 4, pp. 161- 186 ,(1989) , 10.1023/A:1022699900025
A.G. Barto, R.S. Sutton, Reinforcement Learning: An Introduction ,(1988)
Xin Yao, Evolving artificial neural networks Proceedings of the IEEE. ,vol. 87, pp. 1423- 1447 ,(1999) , 10.1109/5.784219
Risto Miikkulainen, Kenneth O. Stanley, Efficient Reinforcement Learning Through Evolving Neural Network Topologies genetic and evolutionary computation conference. pp. 569- 577 ,(2002)
David E. Goldberg, Jon Richardson, Genetic algorithms with sharing for multimodal function optimization international conference on genetic algorithms. pp. 41- 49 ,(1987)