The Influence of Journal Submission Guidelines on Authors' Reporting of Statistics and Use of Open Research Practices

Giofrè D, Cumming G, Fresc L, Boedker I, Tressoldi P (2017) The influence of journal submission guidelines on authors' reporting of statistics and use of open research practices. PLoS ONE 12(4): e0175583. https://doi.org/10.1371/journal.pone.0175583

15 Pages Posted: 9 Jan 2016 Last revised: 19 Apr 2017

See all articles by David Giofré

David Giofré

Liverpool John Moores University

Geoff Cumming

La Trobe University

Luca Fresc

University of Padova

Patrizio E. Tressoldi

Università di Padova

Date Written: April 17, 2017

Abstract

From January 2014, Psychological Science introduced new submission guidelines that encouraged the use of effect sizes, estimation, and meta-analysis (the “new statistics”), required extra detail of methods, and offered badges for use of open science practices. We investigated the use of these practices in empirical articles published by Psychological Science and, for comparison, by the Journal of Experimental Psychology: General, during the period of January 2013 to December 2015. The use of null hypothesis significance testing (NHST) was extremely high at all times and in both journals. In Psychological Science, the use of confidence intervals increased markedly overall, from 28% of articles in 2013 to 70% in 2015, as did the availability of open data (3 to 39%) and open materials (7 to 31%). The other journal showed smaller or much smaller changes. Our findings suggest that journal-specific submission guidelines may encourage desirable changes in authors’ practices.

Keywords: statistical practices, statistical reform, submission guidelines, effect size, confidence intervals, Open Science practices

Suggested Citation

Giofré, David and Cumming, Geoff and Fresc, Luca and Tressoldi, Patrizio E., The Influence of Journal Submission Guidelines on Authors' Reporting of Statistics and Use of Open Research Practices (April 17, 2017). Giofrè D, Cumming G, Fresc L, Boedker I, Tressoldi P (2017) The influence of journal submission guidelines on authors' reporting of statistics and use of open research practices. PLoS ONE 12(4): e0175583. https://doi.org/10.1371/journal.pone.0175583. Available at SSRN: https://ssrn.com/abstract=2712603 or http://dx.doi.org/10.2139/ssrn.2712603

David Giofré (Contact Author)

Liverpool John Moores University ( email )

Redmont Building
Brownlow Hill
Liverpool, L35UG
United Kingdom

Geoff Cumming

La Trobe University ( email )

Department of Economics and Finance
Victoria 3552, 3086
Australia

Luca Fresc

University of Padova ( email )

Via 8 Febbraio
Padova, 2-35122
Italy

Patrizio E. Tressoldi

Università di Padova ( email )

via Venezia 8
Padova, 35131
Italy

HOME PAGE: http://www.patriziotressoldi.it

Register to save articles to
your library

Register

Paper statistics

Downloads
39
Abstract Views
363
PlumX Metrics