White paper on replication

Page, Lionel; Niederle, Muriel; Noussair, Chares N.; and Slonim, Robert (April 2021). The replication crisis, the rise of new research practices and what it means for experimental economics

In the wake of the replication crisis in psychology, a range of new approaches has been advocated to improve scientific practices and the replicability of published studies in behavioural sciences. The ESA Executive Committee commissioned an ad hoc committee to review the issues raised by the replication crisis, how they affect research in experimental economics, and to make recommendations for experimental economics.

The present report is the result of this review. Its content has greatly benefited from the personal views and insights of a large number of ESA members. The views in the community of researchers in experimental economics are diverse. The present report does not aim at determining a strict ESA policy. Rather, it aims to bring to the community of experimental economists the collective wisdom, which is spread across experimentalists. The report presents an informed discussion of the different issues related to replicability and discusses the different solutions, with their benefits and pitfalls.

The report also contains a series of recommendations which aim to address the challenges presented by the replication crisis, while respecting the diversity of views within the ESA community.