High Impact = High Statistical Standards? Not Necessarily So

Posted: 19 Aug 2012

See all articles by Patrizio E. Tressoldi

Patrizio E. Tressoldi

Università di Padova

D. Giofré

University of Padua - Dipartimento di Psicologia Generale

F. Sella

University of Padua - Dipartimento di Psicologia Generale

G. Cumming

affiliation not provided to SSRN

Date Written: August 17, 2012

Abstract

Which are the statistical practices of articles published in journals with high impact factor? Are there differences compared with articles published in journals with lower impact factor which have adopted editorial policies to reduce the impact of limitations of Null Hypothesis Significance Testing? The current study analyzes all articles related to psychological, neuropsychological and medical issues, published in 2011 in four journals with high impact factor: Science, Nature, NEJM and The Lancet, and three journals with lower impact factor: Neuropsychology, Journal of Experimental Psychology-Applied and the American Journal of Public Health. Results show that Null Hypothesis Significance Testing without any use of confidence intervals, effect size, prospective power and model estimation, is the prevalent statistical practice used in articles published in Nature, followed by articles published in Science. In contrast, in all other journals, most articles report confidence intervals and/or effect size measures. We interpreted these differences as consequences of the editorial policies adopted by the journal editors, which are probably the most efficient means to improve the statistical practices in journals with high or low impact factors.

Keywords: NHST, statistical practice, Impact factor, Confidence intervals, effect size

Suggested Citation

Tressoldi, Patrizio E. and Giofré, D. and Sella, F. and Cumming, G., High Impact = High Statistical Standards? Not Necessarily So (August 17, 2012). Available at SSRN: https://ssrn.com/abstract=2131027 or http://dx.doi.org/10.2139/ssrn.2131027

Patrizio E. Tressoldi (Contact Author)

Università di Padova ( email )

via Venezia 8
Padova, 35131
Italy

HOME PAGE: http://www.patriziotressoldi.it

D. Giofré

University of Padua - Dipartimento di Psicologia Generale

via Venezia 8
Padova, 35131
Italy

F. Sella

University of Padua - Dipartimento di Psicologia Generale

via Venezia 8
Padova, 35131
Italy

G. Cumming

affiliation not provided to SSRN

Register to save articles to
your library

Register

Paper statistics

Abstract Views
232
PlumX Metrics