Science Deserves Better: The Imperative to Share Complete Replication Files
Dafoe, Allan. 2014. Science Deserves Better: The Imperative to Share Complete Replication Files. PS: Political Science & Politics. 47 (1): 60–66.
17 Pages Posted: 30 Aug 2013 Last revised: 19 Nov 2014
Date Written: January 2014
Abstract
Scientific knowledge is only as reliable as the empirical analysis on which it is based. For the majority of published statistical analyses, readers have to trust that the scholars correctly implemented the many stages of analysis between primary data collection and the presentation of results — including data cleaning, merging, recoding and transforming, analysis, and output. I advocate the adoption of a simple transparency maxim: good research involves publishing complete replication files, making every step of research as explicit and reproducible as is practical. Benefits of replication transparency include: raising the quality and refutability of scientific inferences; dissemination of useful data and code; greater freedom for scientists to explore each others’ results and data; and a richer scientific conversation. More transparent replication prac- tices are a scientific public good: the costs are small but borne by the authors; the benefits are great and shared by the broader scientific community and public. Strong norms of replication transparency, once established, are likely to be partly self-enforcing. Data is presented on replication practices and the replicability of published works in political science. I outline good replication practices for scholars, and offer recommendations to journals, universities, and funders.
Suggested Citation: Suggested Citation
Do you have a job opening that you would like to promote on SSRN?
Recommended Papers
-
Is the 2007 U.S. Sub-Prime Financial Crisis so Different? an International Historical Comparison
By Carmen Reinhart and Kenneth Rogoff
-
The Aftermath of Financial Crises
By Carmen Reinhart and Kenneth Rogoff
-
The Aftermath of Financial Crises
By Carmen Reinhart and Kenneth Rogoff
-
Banking Crises: An Equal Opportunity Menace
By Carmen Reinhart and Kenneth Rogoff
-
Banking Crises: An Equal Opportunity Menace
By Carmen Reinhart and Kenneth Rogoff
-
Government Debt in Emerging Market Countries: A New Data Set
By Olivier Jeanne and Anastasia Guscina
-
By Carmen Reinhart and Kenneth Rogoff
-
By Carmen Reinhart and Kenneth Rogoff
-
Relative Price Volatility Under Sudden Stops: The Relevance of Balance Sheet Effects
By Guillermo A. Calvo, Alejandro Izquierdo, ...