The role of uncertainty in attentional and choice exploration.

作者: Adrian R. Walker , David Luque , Mike E. Le Pelley , Tom Beesley

DOI: 10.3758/S13423-019-01653-2

关键词: OrganismExploitCognitive psychologyPsychologyTask (project management)

摘要: The exploitation-exploration (EE) trade-off describes how, when making a decision, an organism must often choose between safe alternative with known pay-off, and one or more riskier alternatives uncertain pay-offs. Recently, the concept of EE has been extended to examination how organisms distribute limited attentional resources several stimuli. This work suggests that rules governing environment are certain, participants learn “exploit” by attending preferentially cues provide most information about upcoming events. However, uncertain, people “explore” increasing their attention all may help in predicting In current study, we examine uncertainty affects using contextual two-armed bandit task, where explore both choice behavior. We find evidence for influence on attention. These findings support idea attention, is primary motivator exploration allocation.

参考文章(21)
Y. Niv, R. Daniel, A. Geana, S. J. Gershman, Y. C. Leong, A. Radulescu, R. C. Wilson, Reinforcement learning in multidimensional environments relies on attention mechanisms The Journal of Neuroscience. ,vol. 35, pp. 8145- 8157 ,(2015) , 10.1523/JNEUROSCI.2978-14.2015
W. Bradley Knox, A. Ross Otto, Peter Stone, Bradley C. Love, The Nature of Belief-Directed Exploratory Choice in Human Decision-Making Frontiers in Psychology. ,vol. 2, pp. 398- 398 ,(2012) , 10.3389/FPSYG.2011.00398
E. A. Wasserman, S. M. Elek, D. L. Chatlosh, A. G. Baker, Rating causal relations: Role of probability in judgments of response-outcome contingency. Journal of Experimental Psychology: Learning, Memory and Cognition. ,vol. 19, pp. 174- 188 ,(1993) , 10.1037/0278-7393.19.1.174
Tom Beesley, Katherine P. Nguyen, Daniel Pearson, Mike E. Le Pelley, Uncertainty and predictiveness determine attention to cues during human associative learning. Quarterly Journal of Experimental Psychology. ,vol. 68, pp. 2175- 2199 ,(2015) , 10.1080/17470218.2015.1009919
Peter J. Etchells, Christopher P. Benton, Casimir J. H. Ludwig, Iain D. Gilchrist, Testing a simplified method for measuring velocity integration in saccades using a manipulation of target contrast Frontiers in Psychology. ,vol. 2, pp. 1- 10 ,(2011) , 10.3389/FPSYG.2011.00115
David R. Shanks, Richard J. Tunney, John D. McCarthy, A Re-examination of Probability Matching and Rational Choice Journal of Behavioral Decision Making. ,vol. 15, pp. 233- 250 ,(2002) , 10.1002/BDM.413
Nathaniel D. Daw, John P. O'Doherty, Peter Dayan, Ben Seymour, Raymond J. Dolan, Cortical substrates for exploratory decisions in humans Nature. ,vol. 441, pp. 876- 879 ,(2006) , 10.1038/NATURE04766
Maarten Speekenbrink, Emmanouil Konstantinidis, Uncertainty and Exploration in a Restless Bandit Problem Topics in Cognitive Science. ,vol. 7, pp. 351- 367 ,(2015) , 10.1111/TOPS.12145
M. E. Le Pelley, I. P. L. McLaren, Learned associability and associative change in human causal learning Quarterly Journal of Experimental Psychology Section B-comparative and Physiological Psychology. ,vol. 56, pp. 68- 79 ,(2003) , 10.1080/02724990244000179
Bob Rehder, Aaron B. Hoffman, Eyetracking and selective attention in category learning. Cognitive Psychology. ,vol. 51, pp. 1- 41 ,(2005) , 10.1016/J.COGPSYCH.2004.11.001