Estimating the Reproducibility of Experimental Philosophy

Cova, F., Strickland, B., Abatista, A. G., Allard, A., Andow, J.,... Zhou, X. (2018). Estimating the reproducibility of experimental philosophy. Review of Philosophy and Psychology.

57 Pages Posted: 10 Apr 2020

See all articles by Florian Cova

Florian Cova

University of Geneva

Brent Strickland

Yale University - Department of Psychology

James Andow

affiliation not provided to SSRN

James R. Beebe

State University of New York (SUNY) - Department of Philosophy

Matteo Colombo

affiliation not provided to SSRN

Fiery Cushman

Harvard College

Brian Earp

University of Oxford

Ivar Hannikainen

University of Sheffield - Department of Philosophy; Pontifical Catholic University of Rio de Janeiro (PUC-Rio)

Joshua Knobe

Yale University

Edouard Machery

University of Pittsburgh - Department of History and Philosophy of Science

Jonathan Phillips

Harvard University

Kevin Reuter

affiliation not provided to SSRN

Jan Sprenger

Tilburg University

Kevin P. Tobia

Georgetown University Law Center

Date Written: June 14, 2018

Abstract

Responding to recent concerns about the reliability of the published literature in psychology and other disciplines, we formed the X-Phi Replicability Project (XRP) to estimate the reproducibility of experimental philosophy (osf.io/dvkpr). Drawing on a representative sample of 40 x-phi studies published between 2003 and 2015, we enlisted 20 research teams across 8 countries to conduct a high-quality replication of each study in order to compare the results to the original published findings. We found that x-phi studies – as represented in our sample – successfully replicated about 70% of the time. We discuss possible reasons for this relatively high replication rate in the field of experimental philosophy and offer suggestions for best research practices going forward.

Suggested Citation

Cova, Florian and Strickland, Brent and Andow, James and Beebe, James R. and Colombo, Matteo and Cushman, Fiery and Earp, Brian and Hannikainen, Ivar and Knobe, Joshua and Machery, Edouard and Phillips, Jonathan and Reuter, Kevin and Sprenger, Jan and Tobia, Kevin P., Estimating the Reproducibility of Experimental Philosophy (June 14, 2018). Cova, F., Strickland, B., Abatista, A. G., Allard, A., Andow, J.,... Zhou, X. (2018). Estimating the reproducibility of experimental philosophy. Review of Philosophy and Psychology.. Available at SSRN: https://ssrn.com/abstract=3555417

Florian Cova (Contact Author)

University of Geneva

102 Bd Carl-Vogt
Genève, CH - 1205
Switzerland

Brent Strickland

Yale University - Department of Psychology ( email )

P.O. Box 208205
New Haven, CT 06520-8205
United States

James Andow

affiliation not provided to SSRN

James R. Beebe

State University of New York (SUNY) - Department of Philosophy ( email )

135 Park Hall
Buffalo, NY 14260
United States

Matteo Colombo

affiliation not provided to SSRN

Fiery Cushman

Harvard College ( email )

Cambridge, MA 02138
United States

Brian Earp

University of Oxford ( email )

Mansfield Road
Oxford, Oxfordshire OX1 4AU
United Kingdom

Ivar Hannikainen

University of Sheffield - Department of Philosophy ( email )

Arts Tower
Western Bank
Sheffield S10 2TN
United Kingdom

Pontifical Catholic University of Rio de Janeiro (PUC-Rio) ( email )

Rua Marquas de Sao Vicente, 225
Rio De Janeiro, RJ 22453-900
Brazil

Joshua Knobe

Yale University

New Haven, CT 06520
United States

Edouard Machery

University of Pittsburgh - Department of History and Philosophy of Science ( email )

1017 Cathedral of Learning
4200 Fifth Avenue
Pittsburgh, PA 15260
United States

Jonathan Phillips

Harvard University ( email )

1737 Cambridge Street
Cambridge, MA 02138
United States

Kevin Reuter

affiliation not provided to SSRN

Jan Sprenger

Tilburg University ( email )

P.O. Box 90153
Tilburg, DC Noord-Brabant 5000 LE
Netherlands

Kevin P. Tobia

Georgetown University Law Center ( email )

600 New Jersey Avenue, NW
Washington, DC 20001
United States

HOME PAGE: http://www.law.georgetown.edu/faculty/kevin-tobia/

Here is the Coronavirus
related research on SSRN

Paper statistics

Downloads
13
Abstract Views
128
PlumX Metrics