Evaluating replicability of laboratory experiments in economics

Colin F. Camerer*, Anna Dreber, Eskil Forsell, Teck Hua Ho, Jürgen Huber, Magnus Johannesson, Michael Kirchler, Johan Almenberg, Adam Altmejd, Taizan Chan, Emma Heikensten, Felix Holzmeister, Taisuke Imai, Siri Isaksson, Gideon Nave, Thomas Pfeiffer, Michael Razen, Hang Wu

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

744 Citations (Scopus)

Abstract

The replicability of some scientific findings has recently been called into question.To contribute data about replicability in economics, we replicated 18 studies published in the American Economic Review and the Quarterly Journal of Economics between 2011 and 2014. All of these replications followed predefined analysis plans that weremade publicly available beforehand, and they all have a statistical power of at least 90% to detect the original effect size at the 5% significance level.We found a significant effect in the same direction as in the original study for 11 replications (61%); on average, the replicated effect size is 66% of the original. The replicability rate varies between 67% and 78% for four additional replicability indicators, including a prediction market measure of peer beliefs.

Original languageEnglish
Pages (from-to)1433-1436
Number of pages4
JournalScience
Volume351
Issue number6280
DOIs
Publication statusPublished - Mar 25 2016
Externally publishedYes

ASJC Scopus Subject Areas

  • General

Fingerprint

Dive into the research topics of 'Evaluating replicability of laboratory experiments in economics'. Together they form a unique fingerprint.

Cite this