The Replication Recipe: What Makes for a Convincing Replication?
29 Pages Posted: 24 Jun 2013 Last revised: 14 Oct 2013
Date Written: June 23, 2013
Psychological scientists have recently started to reconsider the importance of close replications in building a cumulative knowledge base; however, there is not a consensus about what constitutes a convincing replication study. To facilitate close and convincing replication attempts we have developed a Replication Recipe, outlining standard criteria for a convincing close replication. This includes faithfully recreating the original study while keeping track of differences, achieving high statistical power, checking the study’s assumptions in new contexts, and pre-registering the study. We also discuss methods for evaluating and reporting replications. Identifying differences between replication and original (sample, culture, lab context, etc.) allows researchers to identify where their replication is on the continuum from “close” to “conceptual”. Our replication recipe can be used by established researchers, teachers, and students to conduct meaningful replication studies and integrate replications into their scholarly habits.
Keywords: replications, replication recipe, statistical power, research methods, pre-registration, solid science
Suggested Citation: Suggested Citation
Do you have a job opening that you would like to promote on SSRN?
Scientific Utopia: II - Restructuring Incentives and Practices to Promote Truth Over Publishability
By Brian A. Nosek, Jeffrey Spies, ...
Perceptual Symbols of Creativity: Coldness Elicits Referential, Warmth Elicits Relational Creativity
By Hans Ijzerman, Angela K-y. Leung, ...
Perceptual Effects of Linguistic Category Priming: The Stapel and Semin (2007) Paradigm Revisited in Twelve Experiments
By Hans Ijzerman, Nina Regenberg, ...
Cumulative and Career-Stage Citation Impact of Social-Personality Psychology Programs and Their Members
By Brian A. Nosek, Jesse Graham, ...
The Reproducibility Project: A Model of Large-Scale Collaboration for Empirical Research on Reproducibility
Replicability of Social-Cognitive Priming: The Case of Weight as an Embodiment of Importance
By Hans Ijzerman, Nikos Padiotis, ...
Toward a Radically Embodied Neuroscience of Attachment and Relationships?
By Lane Beckes, Hans Ijzerman, ...