Simulation of the classically conditioned nictitating membrane response by a neuron-like adaptive element: response topography, neuronal firing, and interstimulus intervals.

作者: John W. Moore , John E. Desmond , Neil E. Berthier , Diana E.J. Blazis , Richard S. Sutton

DOI: 10.1016/0166-4328(86)90092-6

关键词:

摘要: A neuron-like adaptive element with computational features suitable for classical conditioning, the Sutton-Barto (S-B) model, was extended to simulate real-time aspects of conditioned nictitating membrane (NM) response. The concern were response topography, CR-related neuronal firing, and interstimulus interval (ISI) effects forward-delay trace conditioning paradigms. topography NM CR has following features: latency after CS onset decreases over trials; amplitude increases gradually within ISI attains its maximum coincidentally UR. similar pattern characterizes firing some (but not all) neurons in brain regions demonstrated experimentally be important conditioning. variant S-B model described this paper consists a set parameters implementation rules based on 10-ms time steps. It differs from original number ways. main difference is assumption that inputs are instantaneous but instead shaped by unspecified coding processes so as produce outputs conform properties successfully simulates aforementioned topography. also capable simulating appropriate functions, i.e. strength ISIs 250 ms, model's successful treatment multiple-CS phenomena, such blocking, inhibition, higher-order retained present model.

参考文章(20)
Robert A Rescorla, None, A theory of Pavlovian conditioning : Variations in the effectiveness of reinforcement and nonreinforcement Classical conditioning II : Current research and theory. pp. 64- 99 ,(1972)
Andrew G. Barto, Richard S. Sutton, Simulation of anticipatory responses in classical conditioning by a neuron-like adaptive element Behavioural Brain Research. ,vol. 4, pp. 221- 235 ,(1982) , 10.1016/0166-4328(82)90001-8
W. Ronald Salafia, Frederick W. Mis, W. Scott Terry, Robert S. Bartosiak, Anthony P. Daston, Conditioning of the nictitating membrane response of the rabbit (Oryctolagus cuniculus) as a function of length and degree of variation of intertrial interval Animal Learning & Behavior. ,vol. 1, pp. 109- 115 ,(1973) , 10.3758/BF03214574
John W. Moore, Christopher H. Yeo, David A. Oakley, I.Steele Russell, Conditioned inhibition of the nictitating membrane response in decorticate rabbits. Behavioural Brain Research. ,vol. 1, pp. 397- 409 ,(1980) , 10.1016/0166-4328(80)90037-6
Charles F. Levinthal, Ross H. Tartell, Carrie M. Margolin, Howard Fishman, The CS-US interval (ISI) function in rabbit nictitating membrane response conditioning with very long intertriai intervals Animal Learning & Behavior. ,vol. 13, pp. 228- 232 ,(1985) , 10.3758/BF03200014
Marius C. Smith, Steven R. Coleman, I. Gormezano, Classical conditioning of the rabbit's nictitating membrane response at backward, simultaneous, and forward CS-US intervals. Journal of Comparative and Physiological Psychology. ,vol. 69, pp. 226- 231 ,(1969) , 10.1037/H0028212
D. McCormick, R. Thompson, Cerebellum: essential involvement in the classically conditioned eyelid response Science. ,vol. 223, pp. 296- 299 ,(1984) , 10.1126/SCIENCE.6701513
Richard S. Sutton, Andrew G. Barto, Toward a modern theory of adaptive networks: Expectation and prediction. Psychological Review. ,vol. 88, pp. 135- 170 ,(1981) , 10.1037/0033-295X.88.2.135