The Adoption of Statistical Tests by Natural Scientists: An Empirical Analysis
David A. Gulley
Columbia University - Department of Industrial Engineering and Operations Research (IEOR)
May 5, 2012
Tests of statistical significance are routinely used in many research studies. However, there are critics of this paradigm, and also a lingering sense that critical test levels are somewhat arbitrary. This paper adds to the literature by determining the timing and level of acceptance of common tests of statistical inference. Using the archives of the Royal Society, we examined 574 research studies published between 1926 and 1997, by which point adoption was virtually complete. We find that the rate and level of adoption rises over time, in a manner broadly consistent with the theoretical literature on the adoption rate of innovations. We detect the presence of several influences on the rate of adoption, which may include prior custom, the nature of empirical research topics being reported, the increasing ease of computer processing, and possibly journal editorial policies. We find that confidence/significance testing has been adopted by a majority of the scientific community for over 50 years; the customary reliance on 95 percent confidence (five percent significance) is upheld by the data; and that confidence intervals and critical significance levels are both widely reported and often together in recent decades. For historians of science these data suggest that neither Fisher nor Pearson conclusively “won” their private war. The study sheds new light on an issue of considerable practical importance, the admissibility of statistical evidence in most courts in the United States.
Number of Pages in PDF File: 19
Keywords: statistics, courtroom, supreme court, Fisher, Pearson, adoption rate, significance levels, confidence levels, history of science
JEL Classification: B2, B4, C12, K00working papers series
Date posted: March 3, 2012 ; Last revised: March 26, 2013
© 2014 Social Science Electronic Publishing, Inc. All Rights Reserved.
This page was processed by apollo6 in 0.391 seconds