Direct replications in the era of open sampling.
作者： Gabriele Paolacci , Jesse Chandler
DOI: 10.1017/S0140525X18000808
关键词: Replication (statistics) 、 Data collection 、 Selection (genetic algorithm) 、 Data science 、 Computer science 、 Sampling (statistics)
摘要: Data collection in psychology increasingly relies on “open populations” of participants recruited online, which presents both opportunities and challenges for replication. Reduced costs the possibility to access the same populations allows more informative replications. However, researchers should ensure directness their replications by dealing with threats of participant nonnaivete selection effects.
sci-hub.st 参考文章(14)
Gabriele Paolacci, Benjamin R. Newell, Daniel M. Bartels, Neil Stewart, Christoph Ungemach, Jesse Chandler, Adam J. L. Harris, The average laboratory samples a population of 7,300 Amazon Mechanical Turk workers. Judgment and Decision Making. ,vol. 10, pp. 479- 491 ,(2015)
Jesse Chandler, Pam Mueller, Gabriele Paolacci, Nonnaïveté among Amazon Mechanical Turk workers: consequences and solutions for behavioral researchers Behavior Research Methods. ,vol. 46, pp. 112- 130 ,(2014) , 10.3758/S13428-013-0365-7
Yanna Krupnikov, Adam Seth Levine, Cross-Sample Comparisons and External Validity Journal of Experimental Political Science. ,vol. 1, pp. 59- 80 ,(2014) , 10.1017/XPS.2014.7
Eyal Peer, Joachim Vosgerau, Alessandro Acquisti, Reputation as a sufficient condition for data quality on Amazon Mechanical Turk. Behavior Research Methods. ,vol. 46, pp. 1023- 1031 ,(2014) , 10.3758/S13428-013-0434-Y
Jesse Chandler, Danielle Shapiro, Conducting Clinical Research Using Crowdsourced Convenience Samples Annual Review of Clinical Psychology. ,vol. 12, pp. 53- 81 ,(2016) , 10.1146/ANNUREV-CLINPSY-021815-093623
Uri Simonsohn, Small Telescopes Detectability and the Evaluation of Replication Results Psychological Science. ,vol. 26, pp. 559- 569 ,(2015) , 10.1177/0956797614567341
Jesse Chandler, Gabriele Paolacci, Eyal Peer, Pam Mueller, Kate A. Ratliff, Using Nonnaive Participants Can Reduce Effect Sizes Psychological Science. ,vol. 26, pp. 1131- 1139 ,(2015) , 10.1177/0956797615585115
Keela S. Thomson, Daniel M. Oppenheimer, Investigating an alternate form of the cognitive reflection test. Judgment and Decision Making. ,vol. 11, pp. 99- 113 ,(2016)
Sanford E. DeVoe, Julian House, Replications with MTurkers who are naïve versus experienced with academic studies: A comment on Connors, Khamitov, Moroz, Campbell, and Henderson (2015) Journal of Experimental Social Psychology. ,vol. 67, pp. 65- 67 ,(2016) , 10.1016/J.JESP.2015.11.004
Joseph K Goodman, Gabriele Paolacci, Crowdsourcing consumer research Journal of Consumer Research. ,vol. 44, pp. 196- 210 ,(2017) , 10.1093/JCR/UCX047