No Bad Dogs: Ethological Lessons for Learning in Hamsterdam*

作者: Peter M. Todd , Bruce M. Blumberg

DOI:

关键词: EthologyContext (language use)AnimatCreaturesAction selectionSet (psychology)ArchitectureReliability (computer networking)Computer scienceArtificial intelligence

摘要: We present an architecture for autonomous creatures that allows learning to be combined with action selection, based on ideas from ethology. show how temporal-difference may used within the context of ethologically inspired animat build and modify portions behavior network, set fundamental parameters including strength associated individual Releasing Mechanisms, time course appetitive behaviors, rates observed reliability specific contingencies. The algorithm has been implemented as part Hamsterdam toolkit building animated creatures. When in Silas, a virtual dog, enables Silas trained using classical instrumental conditioning.

参考文章(33)
Ian Horswill, A simple, cheap, and robust visual navigation system simulation of adaptive behavior. pp. 129- 136 ,(1993)
Bruce Blumberg, Action-selection in hamsterdam: lessons from ethology simulation of adaptive behavior. pp. 108- 117 ,(1994)
Sara J. Shettleworth, CHAPTER 7 – Biological Approaches to the Study of Learning Animal Learning and Cognition. pp. 185- 219 ,(1994) , 10.1016/B978-0-08-057169-0.50013-9
Peter M. Todd, Geoffrey F. Miller, Exploring adaptive agency II: simulating the evolution of associative learning simulation of adaptive behavior. pp. 306- 315 ,(1991)
Simon Giszter, Reinforcement tuning of action synthesis and selection in a “virtual frog” simulation of adaptive behavior. pp. 290- 300 ,(1994)
Graham Davey, Ecological learning theory ,(1989)
Geoffrey F. Miller, Peter M. Todd, Exploring Adaptive Agency I: Theory and Methods for Simulating the Evolution of Learning Connectionist Models#R##N#Proceedings of the 1990 Summer School. pp. 65- 80 ,(1991) , 10.1016/B978-1-4832-1448-1.50013-5
Richard S. Sutton, Reinforcement learning architectures for animats simulation of adaptive behavior. pp. 288- 296 ,(1991)
Sridhar Mahadevan, Jonathan Connell, Automatic programming of behavior-based robots using reinforcement learning national conference on artificial intelligence. pp. 768- 773 ,(1991)
Carol Grant Gould, James L. Gould, The Animal Mind ,(1994)