The Bayesian Superorganism I: collective probability estimation

作者: Edmund R. Hunt , Nigel R. Franks , Roland J. Baddeley

DOI: 10.1101/468942

关键词: Bayesian probabilityApproximate Bayesian computationMachine learningComputer scienceBayesian inferenceThompson samplingForagingArtificial intelligenceSuperorganism

摘要: Abstract Superorganisms such as social insect colonies are very successful relative to their non-social counterparts. Powerful emergent information processing capabilities would seem contribute abundance, they explore and exploit environment collectively. In this series of three papers, we develop a Bayesian model collective processing, starting here with nest-finding, then examining foraging (part II) externalised memories (pheromone territory markers) in part III. House-hunting Temnothorax ants adept at discovering choosing the best available nest site for colony. Essentially, propose that estimate probability each choice is best, choose highest probability. Viewed way, behavioural algorithm can be understood sophisticated statistical method predates recent mathematical advances by some tens millions years. Here, finding incorporates insights from approximate computation estimation alternative choices; Thompson sampling, an effective regret-minimising decision-making rule viewing terms multi-armed bandit problem (Robbins, 1952). Our framework points potential further bio-inspired techniques. It also facilitates generation hypotheses regarding individual movement behaviours when decisions must made.

参考文章(63)
P. Whittle, Multi-Armed Bandits and the Gittins Index Journal of the Royal Statistical Society: Series B (Methodological). ,vol. 42, pp. 143- 149 ,(1980) , 10.1111/J.2517-6161.1980.TB01111.X
Daniel Clement Dennett, Richard Dawkins, The Extended Phenotype: The Long Reach of the Gene ,(2008)
Lisa A. Levin, Guillermo F. Mendoza, Benjamin M. Grupe, Jennifer P. Gonzalez, Brittany Jellison, Greg Rouse, Andrew R. Thurber, Anders Waren, Biodiversity on the Rocks: Macrofauna Inhabiting Authigenic Carbonate at Costa Rica Methane Seeps. PLOS ONE. ,vol. 10, ,(2015) , 10.1371/JOURNAL.PONE.0131080
Malcolm J. A. Strens, A Bayesian Framework for Reinforcement Learning international conference on machine learning. pp. 943- 950 ,(2000)
Jeremy Wyatt, Exploration and Inference in Learning from Reinforcement University of Edinburgh. College of Science and Engineering. School of Informatics.. ,(1998)
Nathan Korda, David S. Leslie, Anthony Lee, Benedict C. May, Optimistic Bayesian sampling in contextual-bandit problems Journal of Machine Learning Research. ,vol. 13, pp. 2069- 2106 ,(2012) , 10.5555/2188385.2343711
Scott Camazine, Jean-Louis Deneubourg, Nigel R. Franks, James Sneyd, Guy Theraula, Eric Bonabeau, Self-Organization in Biological Systems Princeton University Press. ,(2001) , 10.1515/9780691212920
Thomas N. Sherratt, The optimal sampling strategy for unfamiliar prey. Evolution. ,vol. 65, pp. 2014- 2025 ,(2011) , 10.1111/J.1558-5646.2011.01274.X
Naoki Masuda, Thomas A. O'shea-Wheller, Carolina Doran, Nigel R. Franks, Computational model of collective nest selection by ants with heterogeneous acceptance thresholds. Royal Society Open Science. ,vol. 2, pp. 140533- 140533 ,(2015) , 10.1098/RSOS.140533
Shipra Agrawal, Navin Goyal, Analysis of Thompson Sampling for the Multi-armed Bandit Problem conference on learning theory. ,(2012)