Judgement and Ranking: Living with Hidden Bias

24 Pages Posted: 28 Sep 2016

Date Written: September 27, 2016


The complexity and subjectivity of the judgement task conceals the existence of biases that undermines the quality of the process. This paper presents a weighted aggregation function that attempts to reduce the influence of biased judgements on the final score. We also discuss a set of desirable properties. The proposed weighted aggregation function is able to correct the "nationalism bias" found by Emerson et al. (2009) in the 2000 Olympic Games diving competition and suggest the possibility of a reputation bias. Our results can be applied to judgement sports and other activities that require the aggregation of several personal evaluations.

Keywords: Weighted aggregation function, Judgement by Grading, Nationalism Bias, Reputation Bias, Bias Correction, Olympic Games

JEL Classification: D72, D81, D03

Suggested Citation

Osório Costa, António Miguel, Judgement and Ranking: Living with Hidden Bias (September 27, 2016). Available at SSRN: https://ssrn.com/abstract=2844486 or http://dx.doi.org/10.2139/ssrn.2844486

António Miguel Osório Costa (Contact Author)

Universitat Rovira i Virgili ( email )

Av. de la Universitat 1
Reus, Tarragona 43204
(+34)977759891 (Phone)

HOME PAGE: http://gandalf.fcee.urv.es/departaments/economia/professors/aosorio/

Do you have a job opening that you would like to promote on SSRN?

Paper statistics

Abstract Views
PlumX Metrics