The Replication Recipe: What Makes for a Convincing Replication?

29 Pages Posted: 24 Jun 2013 Last revised: 14 Oct 2013

Mark J. Brandt

Tilburg University

Hans IJzerman

University of Virginia

Ap Dijksterhuis

Radboud University Nijmegen

Frank Farach

University of Washington

Jason Geller

Iowa State University

Roger Giner-Sorolla

University of Kent, Canterbury

James A. Grange

Keele University

Marco Perugini

Università degli Studi di Milano-Bicocca

Jeffrey Spies

University of Virginia

Anna Van 't Veer

Leiden University

Date Written: June 23, 2013

Abstract

Psychological scientists have recently started to reconsider the importance of close replications in building a cumulative knowledge base; however, there is not a consensus about what constitutes a convincing replication study. To facilitate close and convincing replication attempts we have developed a Replication Recipe, outlining standard criteria for a convincing close replication. This includes faithfully recreating the original study while keeping track of differences, achieving high statistical power, checking the study’s assumptions in new contexts, and pre-registering the study. We also discuss methods for evaluating and reporting replications. Identifying differences between replication and original (sample, culture, lab context, etc.) allows researchers to identify where their replication is on the continuum from “close” to “conceptual”. Our replication recipe can be used by established researchers, teachers, and students to conduct meaningful replication studies and integrate replications into their scholarly habits.

Keywords: replications, replication recipe, statistical power, research methods, pre-registration, solid science

Suggested Citation

Brandt, Mark J. and IJzerman, Hans and Dijksterhuis, Ap and Farach, Frank and Geller, Jason and Giner-Sorolla, Roger and Grange, James A. and Perugini, Marco and Spies, Jeffrey and Van 't Veer, Anna, The Replication Recipe: What Makes for a Convincing Replication? (June 23, 2013). Available at SSRN: https://ssrn.com/abstract=2283856 or http://dx.doi.org/10.2139/ssrn.2283856

Mark J. Brandt (Contact Author)

Tilburg University ( email )

P.O. Box 90153
Tilburg, DC 5000 LE
Netherlands

Hans IJzerman

University of Virginia ( email )

Gilmer Hall
Charlottesville, VA 22904
United States

Ap Dijksterhuis

Radboud University Nijmegen ( email )

Nijmegen, 6500 HK
Netherlands

Frank Farach

University of Washington ( email )

Seattle, WA 98195
United States

Jason Geller

Iowa State University ( email )

Ames, IA 50011-2063
United States

Roger Giner-Sorolla

University of Kent, Canterbury ( email )

School of Politics and International Relations
Rutherford College
Canterbury, CT2 7NX

James A. Grange

Keele University ( email )

Keele, Staffordshire ST5 5BG
United Kingdom

Marco Perugini

Università degli Studi di Milano-Bicocca ( email )

Piazza dell'Ateneo Nuovo, 1
Milano, Milan 20126
Italy

Jeffrey Spies

University of Virginia ( email )

1400 University Ave
Charlottesville, VA 22903
United States

Anna Van 't Veer

Leiden University ( email )

Postbus 9500
Leiden
Netherlands

Paper statistics

Downloads
330
Rank
71,487
Abstract Views
2,843