The Experiment Factory: Standardizing Behavioral Experiments.

摘要: The administration of behavioral and experimental paradigms for psychology research is hindered by lack a coordinated effort to develop deploy standardized paradigms. While several frameworks (de Leeuw (2015); McDonnell et al. (2012); Mason Suri (2011); Lange (2015)) have provided infrastructure methods individual groups paradigms, missing linked with system easily them. This disorganization leads redundancy in development, divergent implementations conceptually identical tasks, disorganized error-prone code lacking documentation, difficulty replication. ongoing reproducibility crisis neuroscience (Baker Open Science Collaboration highlights the urgency this challenge: reproducible conditional on deployment equivalent experiments. A large, accessible repository experiments researchers collaboratively most efficiently accomplished through an open source framework. Here we present Experiment Factory, framework development web-based modular includes experiments, virtual machines local or cloud deployment, application drive these components provide developers functions tools further extension. We release (http://www.expfactory.org) that are currently using run set over 80 Amazon Mechanical Turk. By providing both novel holds promise bring accelerate scientific progress shared community resource psychological