An MEG signature corresponding to an axiomatic model of reward prediction error.

作者: Deborah Talmi , Lluis Fuentemilla , Vladimir Litvak , Emrah Duzel , Raymond J. Dolan

DOI: 10.1016/J.NEUROIMAGE.2011.06.051

关键词:

摘要: Optimal decision-making is guided by evaluating the outcomes of previous decisions. Prediction errors are theoretical teaching signals which integrate two features an outcome: its inherent value and prior expectation occurrence. To uncover magnetic signature prediction in human brain we acquired magnetoencephalographic (MEG) data while participants performed a gambling task. Our primary objective was to use formal criteria, based upon axiomatic model (Caplin Dean, 2008a), determine presence timing profile MEG that express errors. We report analyses at sensor level, implemented SPM8, time locked outcome onset. identified, for first time, error, emerged approximately 320 ms after expressed as interaction between valence probability. This signal followed earlier, separate probability, 200 ms outcome. Strikingly, course error signal, well early resembled Feedback-Related Negativity (FRN). In simultaneously EEG obtained robust FRN, but win loss comprised this difference wave did not comply with model. findings motivate explicit examination critical issue embodied computational models seen electrophysiological data.

参考文章(68)
Robert A Rescorla, None, A theory of Pavlovian conditioning : Variations in the effectiveness of reinforcement and nonreinforcement Classical conditioning II : Current research and theory. pp. 64- 99 ,(1972)
Emanuel Donchin, Presidential address, 1980. Surprise!...Surprise? Psychophysiology. ,vol. 18, pp. 493- 513 ,(1981) , 10.1111/J.1469-8986.1981.TB01815.X
G Nolte, MS Hämäläinen, None, Partial signal space projection for artefact removal in MEG measurements: a theoretical analysis. Physics in Medicine and Biology. ,vol. 46, pp. 2873- 2887 ,(2001) , 10.1088/0031-9155/46/11/308
Nico Bunzeck, Christian F. Doeller, Lluis Fuentemilla, Raymond J. Dolan, Emrah Duzel, Reward Motivation Accelerates the Onset of Neural Novelty Signals in Humans to 85 Milliseconds Current Biology. ,vol. 19, pp. 1294- 1300 ,(2009) , 10.1016/J.CUB.2009.06.021
Andrew Caplin, Mark Dean, Axiomatic methods, dopamine and reward prediction error. Current Opinion in Neurobiology. ,vol. 18, pp. 197- 202 ,(2008) , 10.1016/J.CONB.2008.07.007
Matthew R. Roesch, Donna J. Calu, Guillem R. Esber, Geoffrey Schoenbaum, All that glitters ... dissociating attention and outcome expectancy from prediction errors signals. Journal of Neurophysiology. ,vol. 104, pp. 587- 595 ,(2010) , 10.1152/JN.00173.2010
Wolfgang H. R. Miltner, Christoph H. Braun, Michael G. H. Coles, Event-Related Brain Potentials Following Incorrect Feedback in a Time-Estimation Task: Evidence for a “Generic” Neural System for Error Detection Journal of Cognitive Neuroscience. ,vol. 9, pp. 788- 798 ,(1997) , 10.1162/JOCN.1997.9.6.788
Hannah M. Bayer, Brian Lau, Paul W. Glimcher, Statistics of Midbrain Dopamine Neuron Spike Trains in the Awake Primate Journal of Neurophysiology. ,vol. 98, pp. 1428- 1439 ,(2007) , 10.1152/JN.01140.2006
Emrah Düzel, Nico Bunzeck, Marc Guitart-Masip, Bianca Wittmann, Bjoern H Schott, Philippe N Tobler, None, Functional imaging of the human dopaminergic midbrain Trends in Neurosciences. ,vol. 32, pp. 321- 328 ,(2009) , 10.1016/J.TINS.2009.02.005