NDLI: A Bayesian Perspective on the Reproducibility Project: Psychology

Content Provider	PubMed Central
Author	Alexander, Etz Vandekerckhove, Joachim
Editor	Daniele, Marinazzo
Copyright Year	2016
Abstract	We revisit the results of the recent Reproducibility Project: Psychology by the Open Science Collaboration. We compute Bayes factors—a quantity that can be used to express comparative evidence for an hypothesis but also for the null hypothesis—for a large subset (N = 72) of the original papers and their corresponding replication attempts. In our computation, we take into account the likely scenario that publication bias had distorted the originally published results. Overall, 75% of studies gave qualitatively similar results in terms of the amount of evidence provided. However, the evidence was often weak (i.e., Bayes factor < 10). The majority of the studies (64%) did not provide strong evidence for either the null or the alternative hypothesis in either the original or the replication, and no replication attempts provided strong evidence in favor of the null. In all cases where the original paper provided strong evidence but the replication did not (15%), the sample size in the replication was smaller than the original. Where the replication provided strong evidence but the original did not (10%), the replication sample size was larger. We conclude that the apparent failure of the Reproducibility Project to replicate many target effects can be adequately explained by overestimation of effect sizes (or overestimation of evidence against the null hypothesis) due to small sample sizes and publication bias in the psychological literature. We further conclude that traditional sample sizes are insufficient and that a more widespread adoption of Bayesian methods is desirable.
Related Links	http://dx.doi.org/10.1371/journal.pone.0149794
Starting Page	149794
File Format	PDF
ISSN	19326203
e-ISSN	19326203
Journal	PLoS ONE
Issue Number	2
Volume Number	11
Language	English
Publisher	Public Library of Science
Publisher Date	2016-02-01
Access Restriction	Open
Rights Holder	Public Library of Science
Subject Keyword	Biochemistry, Genetics and Molecular Biology(all) Agricultural and Biological Sciences(all) Medicine(all) Research in Higher Education
Content Type	Text
Resource Type	Article
Subject	Multidisciplinary

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

A Bayesian Perspective on Sensory and Cognitive Integration in Pain Perception and Placebo Analgesia

Bayesian Inference on Proportional Elections

A Phylogenetic Perspective on the Evolution of Mediterranean Teleost Fishes

A Perspective on Multiple Waves of Influenza Pandemics

A Geometrical Perspective for the Bargaining Problem

A Bayesian Model of Sensory Adaptation

A Bayesian Search for Transcriptional Motifs

On the Reproducibility of TCGA Ovarian Cancer MicroRNA Profiles

On the origin of mitochondria: a genomics perspective.

A Bayesian Perspective on the Reproducibility Project: Psychology

Similar Documents

A Bayesian Perspective on Sensory and Cognitive Integration in Pain Perception and Placebo Analgesia

Bayesian Inference on Proportional Elections

A Phylogenetic Perspective on the Evolution of Mediterranean Teleost Fishes

A Perspective on Multiple Waves of Influenza Pandemics

A Geometrical Perspective for the Bargaining Problem

A Bayesian Model of Sensory Adaptation

A Bayesian Search for Transcriptional Motifs

On the Reproducibility of TCGA Ovarian Cancer MicroRNA Profiles

On the origin of mitochondria: a genomics perspective.

A Bayesian Perspective on the Reproducibility Project: Psychology