Statistical Uncertainty in the Ranking of Journals and Universities

17 Pages Posted: 7 Mar 2022

See all articles by Magne Mogstad

Magne Mogstad

University of Chicago

Joseph P. Romano

Stanford University - Department of Statistics

Azeem Shaikh

University of Chicago

Daniel Wilhelm

University College London

Multiple version iconThere are 2 versions of this paper

Date Written: February 28, 2022

Abstract

Economists are obsessed with rankings of institutions, journals, or scholars according to the value of some feature of interest. These rankings are invariably computed using estimates rather than the true values of such features. As a result, there may be considerable uncertainty concerning the ranks. In this paper, we consider the problem of accounting for such uncertainty by constructing confidence sets for the ranks. We consider both the problem of constructing marginal confidence sets for the rank of, say, a particular journal as well as simultaneous confidence sets for the ranks of all journals. We apply these confidence sets to draw inferences about uncertainty in the ranking of economics journals and universities by impact factors.

JEL Classification: A0,C12

Suggested Citation

Mogstad, Magne and Romano, Joseph P. and Shaikh, Azeem and Wilhelm, Daniel, Statistical Uncertainty in the Ranking of Journals and Universities (February 28, 2022). University of Chicago, Becker Friedman Institute for Economics Working Paper No. 2022-34, Available at SSRN: https://ssrn.com/abstract=4049119 or http://dx.doi.org/10.2139/ssrn.4049119

Magne Mogstad (Contact Author)

University of Chicago ( email )

1101 East 58th Street
Chicago, IL 60637
United States

Joseph P. Romano

Stanford University - Department of Statistics ( email )

Stanford, CA 94305
United States

Azeem Shaikh

University of Chicago ( email )

1101 East 58th Street
Chicago, IL 60637
United States

Daniel Wilhelm

University College London ( email )

UCL Economics
30 Gordon Street
London, WC1H 0AX
United Kingdom

Do you have a job opening that you would like to promote on SSRN?

Paper statistics

Downloads
51
Abstract Views
183
Rank
493,535
PlumX Metrics