Do Rankings Reflect Research Quality?
42 Pages Posted: 31 Oct 2008
There are 2 versions of this paper
Do Rankings Reflect Research Quality?
Do Rankings Reflect Research Quality?
Date Written: October 2008
Abstract
Publication and citation rankings have become major indicators of the scientific worth of universities and countries, and determine to a large extent the career of individual scholars. We argue that such rankings do not effectively measure research quality, which should be the essence of evaluation. For that reason, an alternative ranking is developed as a quality indicator, based on membership on academic editorial boards of professional journals. It turns out that especially the ranking of individual scholars is far from objective. The results differ markedly, depending on whether research quantity or research quality is considered. Even quantity rankings are not objective; two citation rankings, based on different samples, produce entirely different results. It follows that any career decisions based on rankings are dominated by chance and do not reflect research quality. Instead of propagating a ranking based on board membership as the gold standard, we suggest that committees make use of this quality indicator to find members who, in turn, evaluate the research quality of individual scholars.
Keywords: rankings, universities, scholars, publications, citations
JEL Classification: H43, L15, O38
Suggested Citation: Suggested Citation
Do you have a job opening that you would like to promote on SSRN?
Recommended Papers
-
Publishing as Prostitution? Choosing between One's Own Ideas and Academic Failure
-
How Much Better are the Most Prestigious Journals? The Statistics of Academic Publication
-
Signals in Science - on the Importance of Signaling in Gaining Attention in Science
By Hendrik P. Van Dalen and Kene Henkens
-
Rigor and Relevance in Organization Studies: Idea Migration and Academic Journal Evolution
By Richard L. Daft and Arie Y. Lewin
-
Diversity in Economics: An Analysis of Journal Quality Perceptions