Editorial Decisions and Measuring Information Contents of Reviews

61 Pages Posted: 17 Sep 2014

See all articles by Ayeh Bandeh-Ahmadi

Ayeh Bandeh-Ahmadi

Government of the United States of America - Office of Financial Research; University of Maryland - Department of Economics

Date Written: October 15, 2013


I measure information on distinct facets of quality from a corpus of reviews and characterize how decision-makers integrate this information present in text with that available through other channels. Specifically, I demonstrate that referee comments at a scholarly journal contain information on submissions’ future citation impact above and beyond information available in referee scores. I measure this signal on future citation impact and show that it does not enter into editorial decision-making directly but rather through an interaction that amplifies the information content of referee scores: the more citations a low- or mediocre-scoring paper is likely to get the less likely it is to be published. Secondly, I describe referee comments that are highly predictive of greater citations. Papers that referees say have access to unique datasets, or are written on topics of relevance to ongoing debates or government applications receive greater citations on average. Third, I show the appearance of favoritism amongst editors who accept a higher share of papers that cite themselves is partly a reflection of an ability to draw and select for papers that receive more citations. Finally, I characterize budget constraints on publication space and referee capital and provide some guidance on what types of information editorial systems could capture to promote transparency in future analyses while protecting privacy of authors or referees.

Keywords: influence, signaling, editorial decisions, referee reviews, information asymmetries, collective decision-making, textual analysis, journals, R&D, innovation, scientific commons

JEL Classification: A14, C81, D0, D2, D71, D8

Suggested Citation

Bandeh-Ahmadi, Ayeh, Editorial Decisions and Measuring Information Contents of Reviews (October 15, 2013). Available at SSRN: https://ssrn.com/abstract=2496624 or http://dx.doi.org/10.2139/ssrn.2496624

Ayeh Bandeh-Ahmadi (Contact Author)

Government of the United States of America - Office of Financial Research ( email )

717 14th Street, NW
Washington DC, DC 20005
United States

University of Maryland - Department of Economics ( email )

College Park, MD 20742
United States

HOME PAGE: http://econweb.umd.edu/~bandeh-ahmadi

Do you have a job opening that you would like to promote on SSRN?

Paper statistics

Abstract Views
PlumX Metrics