Quantitative and Qualitative Rankings of Scholars
Schmalenbach Business Review, Vol. 63, pp. 63-91, January 2011
29 Pages Posted: 5 Jul 2011
Date Written: January 1, 2011
Abstract
In a former article we started to argue that publication and citation rankings of individual scholars do not effectively measure research quality, which should in fact be the essence of evaluation (Frey and Rost (2010)). For the field of economics we show that an alternative ranking based on membership on academic editorial boards of professional journals is randomly correlated with citation and publication rankings of these scholars. In this article we go a step further by hypothesizing a systematic, inverted U-shaped relationship between quantitative and qualitative rankings. By relying on a longitudinal data set of management scholars who are part of the international top community in organization science the findings support this multi-tasking effect. While a certain amount of publications indeed reflects aspects of research quality, it also suggests that maximizing publications ignores other essential aspects of research quality that are doubtlessly hard to measure. It follows that if career decisions are only based on high scores in publication rankings the result will be not only haphazard but may be even counterproductive for science.
Keywords: evaluations, rankings, research quality, scholars, universities
JEL Classification: H43, L15, O38
Suggested Citation: Suggested Citation
Do you have a job opening that you would like to promote on SSRN?
Recommended Papers
-
Publishing as Prostitution? Choosing between One's Own Ideas and Academic Failure
-
How Much Better are the Most Prestigious Journals? The Statistics of Academic Publication
-
Signals in Science - on the Importance of Signaling in Gaining Attention in Science
By Hendrik P. Van Dalen and Kene Henkens
-
Rigor and Relevance in Organization Studies: Idea Migration and Academic Journal Evolution
By Richard L. Daft and Arie Y. Lewin
-
Diversity in Economics: An Analysis of Journal Quality Perceptions