NDLI: The Experiment Factory: Standardizing Behavioral Experiments

Content Provider	PubMed Central
Author	Sochat, Vanessa V. Eisenberg, Ian W. Enkavi, A. Zeynep Jamie, Li Bissett, Patrick G. Poldrack, Russell A.
Copyright Year	2016
Abstract	The administration of behavioral and experimental paradigms for psychology research is hindered by lack of a coordinated effort to develop and deploy standardized paradigms. While several frameworks (Mason and Suri, 2011; McDonnell et al., 2012; de Leeuw, 2015; Lange et al., 2015) have provided infrastructure and methods for individual research groups to develop paradigms, missing is a coordinated effort to develop paradigms linked with a system to easily deploy them. This disorganization leads to redundancy in development, divergent implementations of conceptually identical tasks, disorganized and error-prone code lacking documentation, and difficulty in replication. The ongoing reproducibility crisis in psychology and neuroscience research (Baker, 2015; Open Science Collaboration, 2015) highlights the urgency of this challenge: reproducible research in behavioral psychology is conditional on deployment of equivalent experiments. A large, accessible repository of experiments for researchers to develop collaboratively is most efficiently accomplished through an open source framework. Here we present the Experiment Factory, an open source framework for the development and deployment of web-based experiments. The modular infrastructure includes experiments, virtual machines for local or cloud deployment, and an application to drive these components and provide developers with functions and tools for further extension. We release this infrastructure with a deployment (http://www.expfactory.org) that researchers are currently using to run a set of over 80 standardized web-based experiments on Amazon Mechanical Turk. By providing open source tools for both deployment and development, this novel infrastructure holds promise to bring reproducibility to the administration of experiments, and accelerate scientific progress by providing a shared community resource of psychological paradigms.
Related Links	http://dx.doi.org/10.3389/fpsyg.2016.00610
Starting Page	610
File Format	PDF
ISSN	16641078
e-ISSN	16641078
Journal	Frontiers in Psychology
Volume Number	7
Language	English
Publisher	Frontiers Media S.A.
Publisher Date	2016-04-01
Access Restriction	Open
Rights Holder	Frontiers Media S.A.
Subject Keyword	Research in Higher Education
Content Type	Text
Resource Type	Article
Subject	Psychology

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

The Experiment Factory: Standardizing Behavioral Experiments

Further experiments on probability-matching in the pigeon1

Choice in the repeated-gambles experiment

Function transfer in human operant experiments: the role of stimulus pairings.

Maze Experiment

On the proper control of luminance cues in pigeon color-vision experiments.

The silicon controlled rectifier as a switching device in operant-conditioning experiments.

Evaluating the logic of perspective-taking experiments

Some Notes on “Bursts” in Free-operant Avoidance Experiments

The Experiment Factory: Standardizing Behavioral Experiments

Similar Documents

The Experiment Factory: Standardizing Behavioral Experiments

Further experiments on probability-matching in the pigeon1

Choice in the repeated-gambles experiment

Function transfer in human operant experiments: the role of stimulus pairings.

Maze Experiment

On the proper control of luminance cues in pigeon color-vision experiments.

The silicon controlled rectifier as a switching device in operant-conditioning experiments.

Evaluating the logic of perspective-taking experiments

Some Notes on “Bursts” in Free-operant Avoidance Experiments

The Experiment Factory: Standardizing Behavioral Experiments