Evolving Action Abstractions for Real-Time Planning in Extensive-Form Games

作者: Julian RH Marino , Rubens O Moraes , Claudio Toledo , Levi HS Lelis , None

DOI: 10.1609/AAAI.V33I01.33012330

关键词: Extensive-form gameAction (philosophy)Theoretical computer scienceSelection (relational algebra)Nash equilibriumEvolutionary algorithmComputer scienceSearch algorithmSet (abstract data type)Key (cryptography)

摘要: A key challenge for planning systems in real-time multiagent domains is to search large action spaces decide an agent’s next action. Previous works showed that handcrafted abstractions allow focus their on a subset of promising actions. In this paper we show the problem generating can be cast as selecting pure strategies from pool options. We model selection two-player game which strategy set players powerset options— call game. then present evolutionary algorithm solving such Empirical results small matches µRTS our approach able converge Nash equilibrium Also, larger algorithms using derived by are substantially outperform all state-of-the-art tested.

参考文章(23)
Robert Holte, John Hawkin, Duane Szafron, Automated action abstraction of imperfect information extensive-form games national conference on artificial intelligence. pp. 681- 687 ,(2011)
David W. Aha, Pieter Spronck, Hector Muñoz-Avila, Marc J. V. Ponsen, Automatically Generating Game Tactics through Evolutionary Learning innovative applications of artificial intelligence. ,vol. 27, pp. 75- 84 ,(2006) , 10.1609/AIMAG.V27I3.1894
Tuomas Sandholm, Abstraction for solving large incomplete-information games national conference on artificial intelligence. pp. 4127- 4131 ,(2015)
Niels Justesen, Balint Tillman, Julian Togelius, Sebastian Risi, Script- and cluster-based UCT for StarCraft computational intelligence and games. pp. 1- 8 ,(2014) , 10.1109/CIG.2014.6932900
David Churchill, Michael Buro, Portfolio greedy search and simulation for large-scale combat in starcraft computational intelligence and games. pp. 1- 8 ,(2013) , 10.1109/CIG.2013.6633643
Sheldon M. Ross, GOOFSPIEL -- THE GAME OF PURE STRATEGY Journal of Applied Probability. ,vol. 8, pp. 621- 625 ,(1971) , 10.1017/S0021900200035725
J. v. Neumann, Zur Theorie der Gesellschaftsspiele Mathematische Annalen. ,vol. 100, pp. 295- 320 ,(1928) , 10.1007/BF01448847
Pieter Spronck, Marc Ponsen, Ida Sprinkhuizen-Kuyper, Eric Postma, Adaptive game AI with dynamic scripting Machine Learning. ,vol. 63, pp. 217- 248 ,(2006) , 10.1007/S10994-006-6205-6