2005 Special issue: Methods for reducing interference in the Complementary Learning Systems model: Oscillating inhibition and autonomous memory rehearsal

作者: Kenneth A. Norman , Ehren L. Newman , Adler J. Perotte

DOI: 10.1016/J.NEUNET.2005.08.010

关键词: NeuroplasticityProcess (engineering)Computer scienceTraining setMemorizationMachine learningForgettingNeocortexHippocampusCatastrophic interferenceHebbian theoryMemory rehearsalLeabraArtificial neural networkArtificial intelligence

摘要: The stability-plasticity problem (i.e. how the brain incorporates new information into its model of world, while at same time preserving existing knowledge) has been forefront computational memory research for several decades. In this paper, we critically evaluate well Complementary Learning Systems theory hippocampo-cortical interactions addresses problem. We identify two major challenges model: Finding a learning algorithm cortex and hippocampus that enacts selective strengthening weak memories, punishment competing memories; preventing catastrophic forgetting in case non-stationary environments when items are temporarily removed from training set). then discuss potential solutions to these problems: First, describe recently developed leverages neural oscillations find parts memories (so they can be strengthened) strong competitors punished), show outperforms other algorithms (CPCA Hebbian Leabra memorizing overlapping patterns. Second, autonomous re-activation (separately hippocampus) during REM sleep, coupled with oscillating algorithm, reduce rate input patterns no longer present environment. simple demonstration process prevent interference an AB-AC paradigm. . ate

参考文章(92)
Sidarta Ribeiro, Damien Gervasoni, Ernesto S Soares, Yi Zhou, Shih-Chieh Lin, Janaina Pantoja, Michael Lavine, Miguel A L Nicolelis, None, Long-lasting novelty-induced neuronal reverberation during slow-wave sleep in multiple forebrain areas. PLOS Biology. ,vol. 2, ,(2004) , 10.1371/JOURNAL.PBIO.0020024
M Anderson, Rethinking interference theory: Executive control and the mechanisms of forgetting. Journal of Memory and Language. ,vol. 49, pp. 415- 445 ,(2003) , 10.1016/J.JML.2003.08.006
Lionel Standing, Learning 10,000 pictures. Quarterly Journal of Experimental Psychology. ,vol. 25, pp. 207- 222 ,(1973) , 10.1080/14640747308400340
A. Sirota, J. Csicsvari, D. Buhl, G. Buzsaki, Communication between neocortex and hippocampus during sleep in rodents Proceedings of the National Academy of Sciences of the United States of America. ,vol. 100, pp. 2065- 2069 ,(2003) , 10.1073/PNAS.0437938100
RGM Morris, Parallel & distributed processing ACM SIGGRAPH 2005 Courses on - SIGGRAPH '05. pp. 11- ,(2005) , 10.1145/1198555.1198750
Teresa A. Blaxton, James H. Neely, Inhibition from semantically related primes: evidence of a category-specific inhibition. Memory & Cognition. ,vol. 11, pp. 500- 510 ,(1983) , 10.3758/BF03196987
Randall C. O'Reilly, Jerry W. Rudy, Conjunctive representations in learning and memory: principles of cortical and hippocampal function. Psychological Review. ,vol. 108, pp. 311- 345 ,(2001) , 10.1037/0033-295X.108.2.311
Alessandro Treves, Edmund T. Rolls, Computational analysis of the role of the hippocampus in memory. Hippocampus. ,vol. 4, pp. 374- 391 ,(1994) , 10.1002/HIPO.450040319