Estimating the Reproducibility of Experimental Philosophy
Cova, F., Strickland, B., Abatista, A. G., Allard, A., Andow, J.,... Zhou, X. (2018). Estimating the reproducibility of experimental philosophy. Review of Philosophy and Psychology.
57 Pages Posted: 10 Apr 2020
Date Written: June 14, 2018
Responding to recent concerns about the reliability of the published literature in psychology and other disciplines, we formed the X-Phi Replicability Project (XRP) to estimate the reproducibility of experimental philosophy (osf.io/dvkpr). Drawing on a representative sample of 40 x-phi studies published between 2003 and 2015, we enlisted 20 research teams across 8 countries to conduct a high-quality replication of each study in order to compare the results to the original published findings. We found that x-phi studies – as represented in our sample – successfully replicated about 70% of the time. We discuss possible reasons for this relatively high replication rate in the field of experimental philosophy and offer suggestions for best research practices going forward.
Suggested Citation: Suggested Citation