P-Curve and Effect Size: Correcting for Publication Bias Using Only Significant Results
University of Pennsylvania - The Wharton School
Leif D. Nelson
University of California, Berkeley - Haas School of Business
Joseph P. Simmons
University of Pennsylvania - The Wharton School; University of Pennsylvania - Operations & Information Management Department
April 27, 2014
Journals tend to publish only statistically significant evidence, creating a scientific record that markedly overstates the size of effects. We provide a new tool that corrects for this bias without requiring access to nonsignificant results. It capitalizes on the fact that the distribution of significant p-values, p-curve, is a function of the true underlying effect. Researchers armed only with sample sizes and test results of the published findings can correct for publication bias. We validate the technique with simulations and by re-analyzing data from the Many-Labs Replication project. We demonstrate that p-curve can arrive at conclusions opposite that of existing tools by re-analyzing the meta-analysis of the “choice overload” literature.
Number of Pages in PDF File: 33
Keywords: Publication bias, p-curveworking papers series
Date posted: January 11, 2014 ; Last revised: June 12, 2014
© 2014 Social Science Electronic Publishing, Inc. All Rights Reserved.
This page was processed by apollo3 in 0.391 seconds