Relative Performance Measurement of Researchers: The High Impact of Data Source Selection

Hamburg University of Technology (TUHH), Management@TUHH Research Paper Series No. 5

28 Pages Posted: 15 Nov 2011 Last revised: 30 Oct 2012

See all articles by Matthias Meyer

Matthias Meyer

Technical University Hamburg-Harburg (TUHH)

Rüdiger W. Waldkirch

South Westphalia University

Michael A. Zaggl

Technical University Hamburg-Harburg (TUHH)

Date Written: August 1, 2011

Abstract

This paper investigates the impact of choosing between four data sources on the relative performance measurement of scholars concerning their research output. It compares publication measures from the Social Science Citation Index, Scopus, Google Scholar, and the Handelsblatt. The study is based on data of 298 German-speaking accounting and marketing scholars. Our results show that rankings can differ considerably, and the observed correlations are in many cases even lower than those reported in previous studies are. We investigate several causes for these differences and show that data source selection generally has a higher effect than does measure selection. The results also suggest that performance measures based on Google Scholar provide information complementary to the more traditional data sources. Finally, we find differences to be more pronounced for accounting, a finding that suggests that decision makers must pay more detailed attention when using rankings in this field.

Keywords: citations, decision making, Google Scholar, Handelsblatt ranking, performance measurement, publications, ranking, research productivity, Scopus, Social Science Citation Index

Suggested Citation

Meyer, Matthias and Waldkirch, Rüdiger W. and Zaggl, Michael A., Relative Performance Measurement of Researchers: The High Impact of Data Source Selection (August 1, 2011). Hamburg University of Technology (TUHH), Management@TUHH Research Paper Series No. 5, Available at SSRN: https://ssrn.com/abstract=1959411 or http://dx.doi.org/10.2139/ssrn.1959411

Matthias Meyer (Contact Author)

Technical University Hamburg-Harburg (TUHH) ( email )

Schwarzenbergstrasse 95
Hamburg, DE Hamburg 21073
Germany

Rüdiger W. Waldkirch

South Westphalia University ( email )

Lindenstrasse 53
Meschede, 59872
Germany

Michael A. Zaggl

Technical University Hamburg-Harburg (TUHH) ( email )

Schwarzenbergstrasse 95
Hamburg, DE Hamburg 21073
Germany

Do you have a job opening that you would like to promote on SSRN?

Paper statistics

Downloads
141
Abstract Views
983
rank
257,003
PlumX Metrics