Download this Paper Open PDF in Browser

Science Deserves Better: The Imperative to Share Complete Replication Files

Dafoe, Allan. 2014. Science Deserves Better: The Imperative to Share Complete Replication Files. PS: Political Science & Politics. 47 (1): 60–66.

17 Pages Posted: 30 Aug 2013 Last revised: 19 Nov 2014

Allan Dafoe

Yale University

Date Written: January 2014

Abstract

Scientific knowledge is only as reliable as the empirical analysis on which it is based. For the majority of published statistical analyses, readers have to trust that the scholars correctly implemented the many stages of analysis between primary data collection and the presentation of results — including data cleaning, merging, recoding and transforming, analysis, and output. I advocate the adoption of a simple transparency maxim: good research involves publishing complete replication files, making every step of research as explicit and reproducible as is practical. Benefits of replication transparency include: raising the quality and refutability of scientific inferences; dissemination of useful data and code; greater freedom for scientists to explore each others’ results and data; and a richer scientific conversation. More transparent replication prac- tices are a scientific public good: the costs are small but borne by the authors; the benefits are great and shared by the broader scientific community and public. Strong norms of replication transparency, once established, are likely to be partly self-enforcing. Data is presented on replication practices and the replicability of published works in political science. I outline good replication practices for scholars, and offer recommendations to journals, universities, and funders.

Suggested Citation

Dafoe, Allan, Science Deserves Better: The Imperative to Share Complete Replication Files (January 2014). Dafoe, Allan. 2014. Science Deserves Better: The Imperative to Share Complete Replication Files. PS: Political Science & Politics. 47 (1): 60–66.. Available at SSRN: https://ssrn.com/abstract=2318223 or http://dx.doi.org/10.2139/ssrn.2318223

Allan Dafoe (Contact Author)

Yale University ( email )

Paper statistics

Downloads
232
Rank
112,174
Abstract Views
1,168