Publication Performance vs. Influence: On the Questionable Value of Quality Weighted Publication Rankings

Abstract

In broad parts of the scientific community the position in publication performance rankings, based on journal quality ratings is seen as highly reputational for the scientist. This contribution provides evidence that, at least in economics, such publication performance measures can not always be reconciled with measures for academic influence such as citation-based measures. We analyze data from the Scopus database as well as from the prestigious German-based Handelsblatt ranking for 100 renowned economists (lifetime achievement). Scholarly influence is proxied by various bibliometric indicators such as the number of citations, the h-index, the citations of the most cited paper as well as the hardly honorable Pi-Beta-score (“Publications Ignored, By Even The Author(s)”). We argue that publication performance measures based on journal ratings, such as the Handelsblatt rankings, are not good proxies for an economist’s impact within the scientific community. From this perspective the value of publication performance rankings based on journal quality ratings is questionable.

Keywords: economics, academic reputation, academic rankings, influence, citations, Scopus, Handelsblatt ranking, academic journals

JEL Classification: A120, A140