Download this Paper Open PDF in Browser

The Citation Impact of German Sociology Journals: Some Problems with the Use of Scientometric Indicators in Journal and Research Evaluations

Soziale Welt (Forthcoming)

20 Pages Posted: 24 Dec 2014 Last revised: 13 Mar 2015

Loet Leydesdorff

University of Amsterdam - Amsterdam School of Communication Research (ASCoR)

Staša Milojević

Indiana University Bloomington - School of Informatics and Computing

Date Written: March 12, 2015

Abstract

We analyze the citation impacts (‘cited’) and citation practices (‘citing’) of sociological journals which publish in German, and discuss drawbacks of using the journal impact factor (IF) to assess the quality of these journals. Whereas journal impact factors measure short-term (2-year) impacts at research fronts, sociological literature moves slowly in terms of citations: the median age of citations to sociology journals is mostly longer than ten years. Citation in a field without a research front may indicate codification with a different dynamics. For example, Merton’s (1968) Matthew Effect is frequently cited by network analysts as an example of preferential attachment. Secondly, circulation can be impeded due to a language barrier. Thirdly, citation distributions are heavily skewed because of the positive loops (preferential attachment). Given this skewness one should not use quasi-averages (such as the IF). Using non-parametric statistics (e.g., percentiles), however, requires delineation of field-specific reference sets. What would be a relevant reference set in the case we examine: other sociological journals or other social-science journals in German? The German sociology journals are cited by the latter, but are citing the former as the knowledge bases. Fourth, the attribution of journal measures to individual paper implies an ecological fallacy: inferences about the nature of single records (here: papers) are deduced from inferences for the groups to which these records belong (here: the journal where the papers were published). Finally, algorithmic constructs (e.g., the various rankings) cannot be used for policy or management purposes without validation or specification of statistical error.

Keywords: sociology, impact, citation, Merton, German, journal

Suggested Citation

Leydesdorff, Loet and Milojević, Staša, The Citation Impact of German Sociology Journals: Some Problems with the Use of Scientometric Indicators in Journal and Research Evaluations (March 12, 2015). Soziale Welt (Forthcoming). Available at SSRN: https://ssrn.com/abstract=2541908 or http://dx.doi.org/10.2139/ssrn.2541908

Loet Leydesdorff (Contact Author)

University of Amsterdam - Amsterdam School of Communication Research (ASCoR) ( email )

PO Box 15793
Amsterdam, 1001 NG
Netherlands

HOME PAGE: http://www.leydesdorff.net

Staša Milojević

Indiana University Bloomington - School of Informatics and Computing ( email )

901 E 10th St
Bloomington, IN 47401
United States

Paper statistics

Downloads
183
Rank
139,442
Abstract Views
1,018