The Replication Recipe: What Makes for a Convincing Replication?

29 Pages Posted: 24 Jun 2013 Last revised: 14 Oct 2013

See all articles by Mark Brandt

Mark Brandt

Tilburg University

Hans IJzerman

Université Grenoble Alpes

Ap Dijksterhuis

Radboud University Nijmegen

Frank Farach

University of Washington

Jason Geller

Iowa State University

Roger Giner-Sorolla

University of Kent - Canterbury Campus

James Grange

Keele University

Marco Perugini

Università degli Studi di Milano-Bicocca

Jeffrey Spies

University of Virginia

Anna Van 't Veer

Leiden University

Date Written: June 23, 2013

Abstract

Psychological scientists have recently started to reconsider the importance of close replications in building a cumulative knowledge base; however, there is not a consensus about what constitutes a convincing replication study. To facilitate close and convincing replication attempts we have developed a Replication Recipe, outlining standard criteria for a convincing close replication. This includes faithfully recreating the original study while keeping track of differences, achieving high statistical power, checking the study’s assumptions in new contexts, and pre-registering the study. We also discuss methods for evaluating and reporting replications. Identifying differences between replication and original (sample, culture, lab context, etc.) allows researchers to identify where their replication is on the continuum from “close” to “conceptual”. Our replication recipe can be used by established researchers, teachers, and students to conduct meaningful replication studies and integrate replications into their scholarly habits.

Keywords: replications, replication recipe, statistical power, research methods, pre-registration, solid science

Suggested Citation

Brandt, Mark and IJzerman, Hans and Dijksterhuis, Ap and Farach, Frank and Geller, Jason and Giner-Sorolla, Roger and Grange, James and Perugini, Marco and Spies, Jeffrey and Van 't Veer, Anna, The Replication Recipe: What Makes for a Convincing Replication? (June 23, 2013). Available at SSRN: https://ssrn.com/abstract=2283856 or http://dx.doi.org/10.2139/ssrn.2283856

Mark Brandt (Contact Author)

Tilburg University ( email )

P.O. Box 90153
Tilburg, DC Noord-Brabant 5000 LE
Netherlands

Hans IJzerman

Université Grenoble Alpes ( email )

Grenoble
France

Ap Dijksterhuis

Radboud University Nijmegen ( email )

Postbus 9108
Nijmegen, 6500 HK
Netherlands

Frank Farach

University of Washington ( email )

Seattle, WA 98195
United States

Jason Geller

Iowa State University ( email )

613 Wallace Road
Ames, IA 50011-2063
United States

Roger Giner-Sorolla

University of Kent - Canterbury Campus ( email )

School of Politics and International Relations
Rutherford College
Canterbury, CT2 7NX

James Grange

Keele University ( email )

Keele, Staffordshire ST5 5BG
United Kingdom

Marco Perugini

Università degli Studi di Milano-Bicocca ( email )

Piazza dell'Ateneo Nuovo, 1
Milano, Milan 20126
Italy

Jeffrey Spies

University of Virginia ( email )

1400 University Ave
Charlottesville, VA 22903
United States

Anna Van 't Veer

Leiden University ( email )

Postbus 9500
Leiden
Netherlands

Do you have a job opening that you would like to promote on SSRN?

Paper statistics

Downloads
586
Abstract Views
5,129
Rank
74,990
PlumX Metrics