Intellectual Influence: Quality Versus Quantity
24 Pages Posted: 23 Mar 2012 Last revised: 19 May 2012
Date Written: March 6, 2012
The evaluation of scientific output has a key role in the allocation of research funds and academic positions. Decisions are often based on quality indicators for academic journals and over the years a handful of scoring methods have been proposed for this purpose. Discussing the most prominent methods (de facto standards) we show that they do not distinguish quality from quantity at article level. The systematic bias we find is analytically tractable and implies that the methods are manipulable. We introduce modified methods that correct for this bias, and use them to provide rankings of economic journals. Our methodology is transparent; our results are replicable.
Keywords: Scoring, Ranking, Impact factor, Invariant method, LP method, Invariance to article-splitting, Economics journals classification, economic theorists
JEL Classification: A1, C8, D72, Y1
Suggested Citation: Suggested Citation