作者: Yael Niv , Nathaniel D Daw , Daphna Joel , Peter Dayan , None
DOI: 10.1007/S00213-006-0502-4
关键词: Incentive salience 、 Reinforcement 、 Reinforcement learning 、 Dopamine 、 Nucleus accumbens 、 Tonic (physiology) 、 Striatum 、 Psychology 、 Dopaminergic 、 Neuroscience
摘要: Rationale Dopamine neurotransmission has long been known to exert a powerful influence over the vigor, strength, or rate of responding. However, there exists no clear understanding computational foundation for this effect; predominant accounts dopamine’s function focus on role phasic dopamine in controlling discrete selection between different actions and have nothing say about response vigor indeed freeoperant tasks which it is typically measured. Objectives We seek accommodate free-operant behavioral within realm models optimal control thereby capture how dopaminergic motivational manipulations affect vigor. Methods construct an average reward reinforcement learning model subjects choose both action perform also latency with it. Optimal balances costs acting quickly against benefits getting earlier chooses best latency. Results In framework, long-run plays key as opportunity cost mediates influences rates review evidence suggesting that reported by tonic levels putatively nucleus accumbens. Conclusions Our extension unites psychologically computationally inspired ideas striatum, explaining from normative point view why higher might be associated more vigorous