Does Learning Imply a Decrease in the Entropy of Behavior

作者: Paul E. Smaldino

DOI:

关键词:

摘要: Shannon's information entropy measures of the uncertainty an event's outcome. If learning about a system reflects decrease in uncertainty, then plausible intuition is that should be accompanied by organism's actions and/or perceptual states. To address whether this valid, I examined artificial organism -- simple robot learned to navigate arena and analyzed outcome variables action, state, reward. Entropy did indeed initial stages learning, but two factors complicated scenario: (1) introduction new options discovered during process (2) shifting patterns environmental states resulting from changes robot's movement strategies. These lead subsequent increase as agent learned. end with discussion utility information-based characterizations learning.

参考文章(18)
C. H. Bennett, Logical depth and physical complexity A half-century survey on The Universal Turing Machine. pp. 227- 257 ,(1988)
Charles R. Gallistel, The organization of learning ,(1990)
Sue Healy, None, Spatial representation in animals. Oxford University Press. ,(1998)
Uğur M. Erdem, Michael Hasselmo, A Goal-Directed Spatial Navigation Model Using Forward Trajectory Planning Based on Grid Cells European Journal of Neuroscience. ,vol. 35, pp. 916- 931 ,(2012) , 10.1111/J.1460-9568.2012.08015.X
M. Wilson, B. McNaughton, Dynamics of the hippocampal ensemble code for space Science. ,vol. 261, pp. 1055- 1058 ,(1993) , 10.1126/SCIENCE.8351520
Paul E. Smaldino, Peter J. Richerson, The origins of options. Frontiers in Neuroscience. ,vol. 6, pp. 50- 50 ,(2012) , 10.3389/FNINS.2012.00050
CE Shennon, Warren Weaver, A mathematical theory of communication Bell System Technical Journal. ,vol. 27, pp. 379- 423 ,(1948) , 10.1002/J.1538-7305.1948.TB01338.X
Bertrand Russell, New Hopes for a Changing World ,(1951)