Tonic dopamine: opportunity costs and the control of response vigor.

作者: Yael Niv , Nathaniel D Daw , Daphna Joel , Peter Dayan , None

DOI: 10.1007/S00213-006-0502-4

关键词: Incentive salienceReinforcementReinforcement learningDopamineNucleus accumbensTonic (physiology)StriatumPsychologyDopaminergicNeuroscience

摘要: Rationale Dopamine neurotransmission has long been known to exert a powerful influence over the vigor, strength, or rate of responding. However, there exists no clear understanding computational foundation for this effect; predominant accounts dopamine’s function focus on role phasic dopamine in controlling discrete selection between different actions and have nothing say about response vigor indeed freeoperant tasks which it is typically measured. Objectives We seek accommodate free-operant behavioral within realm models optimal control thereby capture how dopaminergic motivational manipulations affect vigor. Methods construct an average reward reinforcement learning model subjects choose both action perform also latency with it. Optimal balances costs acting quickly against benefits getting earlier chooses best latency. Results In framework, long-run plays key as opportunity cost mediates influences rates review evidence suggesting that reported by tonic levels putatively nucleus accumbens. Conclusions Our extension unites psychologically computationally inspired ideas striatum, explaining from normative point view why higher might be associated more vigorous

参考文章(111)
Y Niv, D Joel, P Dayan, ND Daw, Motivational effects on behavior: Towards a reinforcement learning model of rates of responding Computational and Systems Neuroscience Meeting (COSYNE 2005). pp. 209- ,(2005)
Rolf Kötter, Jeff Wickens, Cellular models of reinforcement. The MIT Press. ,(1995)
James C Houk, James L Adams, Andrew G Barto, A Model of How the Basal Ganglia Generate and Use Neural Signals That Predict Reinforcement MIT Press. pp. 249- 270 ,(1994)
Michael Gabriel, John Moore, None, Learning and Computational Neuroscience: Foundations of Adaptive Networks MIT Press. ,(1990)
Dopamine in the CNS II Springer Berlin Heidelberg. ,(2002) , 10.1007/978-3-642-56051-4
Jerzy Konorski, Integrative activity of the brain : an interdisciplinary approach University of Chicago Press. ,(1967)
Takemasa Satoh, Sadamu Nakai, Tatsuo Sato, Minoru Kimura, Correlated Coding of Motivation and Outcome of Decision by Dopamine Neurons The Journal of Neuroscience. ,vol. 23, pp. 9913- 9923 ,(2003) , 10.1523/JNEUROSCI.23-30-09913.2003
Current developments in psychopharmacology Spectrum , distributed by Halsted Press. ,(1981) , 10.1007/978-94-011-8123-5