Improving Temporal Difference game agent control using a dynamic exploration during control learning

作者: Leo Galway , Darryl Charles , Michaela Black

DOI: 10.1109/CIG.2009.5286497

关键词: Genetic algorithmControl theorySoftware agentArtificial intelligenceComputational intelligenceAction selectionComputer scienceMachine learningTemporal difference learningVariation (game tree)Reinforcement learning

摘要: This paper investigates the use of a dynamically generated exploration rate when using reinforcement learning-based game agent controller within dynamic digital environment. Temporal Difference learning has been employed for real-time gereration reactive behaviors variation classic arcade Pac-Man. Due to nature environment initial experiments made static, low value utilized by action selection during learning. However, further were conducted which prior genetic algorithm. Results obtained have shown that an improvement in overall performance may be achieved is used. In particular, if algorithm controlled measure current agent, gains achieved.

参考文章(22)
Peter Gorniak, Ian Davis, SquadSmart hierarchical planning and coordinated plan execution for squads of characters national conference on artificial intelligence. pp. 14- 19 ,(2007)
Colin Fyfe, Darryl Charles, Michaela M. Black, Leo Galway, Temporal Difference Control within a Dynamic Environment. GAMEON. pp. 42- 47 ,(2007)
Jeff Orkin, Agent architecture considerations for real-time planning in games national conference on artificial intelligence. pp. 105- 110 ,(2005)
Vincent Corruble, Charles Madeira, Geber Ramalho, Designing a reinforcement learning-based adaptive AI for large-scale strategy games national conference on artificial intelligence. pp. 121- 123 ,(2006)
Georgios N. Yannakakis, John Hallam, Evolving opponents for interesting interactive computer games MIT PRESS. ,(2004)
Ralf Herbrich, Thore Graepel, Julian Gold, LEARNING TO FIGHT pp. 193- 200 ,(2004)
Damien Ernst, Arthur Louette, Introduction to Reinforcement Learning MIT Press. ,(1998)
Darryl Charles, Michaela M. Black, Leo Galway, Improvement in Game Agent Control Using State-Action Value Scaling the european symposium on artificial neural networks. pp. 155- 160 ,(2008)