Human Judgement is Heavy Tailed: Empirical Evidence and Implications for the Aggregation of Estimates and Forecasts

36 Pages Posted: 13 Jul 2010

See all articles by Miguel Sousa Lobo

Miguel Sousa Lobo

INSEAD - Decision Sciences

Dai Yao

The Hong Kong Polytechnic University

Date Written: July 12, 2010

Abstract

How frequent are large disagreements in human judgment? The substantial literature relating to expert assessments of real-valued quantities and their aggregation almost universally assumes that errors follow a jointly normal distribution. We investigate this question empirically using 17 datasets that include over 20,000 estimates and forecasts. We findnd incontrovertible evidence for excess kurtosis, that is, of fat tails. Despite the diversity of the analyzed datasets as regards to the degree of uncertainty about the quantity being assessed and to the level of expertise and sophistication of those making the assessments, we find consistency in the frequency with which an expert is in large disagreement with the consensus. Fitting a generalized normal distribution to the data, we find values for the shape parameter ranging from 1 to 1.6 (where 1 is the double-exponential distribution, and 2 the normal distribution). This has important implications, in particular for the aggregation of expert estimates and forecasts. We describe optimal Bayesian aggregation with heavy tails, and propose a simple average-median average heuristic that performs well for the range of empirically observed distributions.

Suggested Citation

Sousa Lobo, Miguel and Yao, Dai, Human Judgement is Heavy Tailed: Empirical Evidence and Implications for the Aggregation of Estimates and Forecasts (July 12, 2010). INSEAD Working Paper No. 2010/48/DS, Available at SSRN: https://ssrn.com/abstract=1638811 or http://dx.doi.org/10.2139/ssrn.1638811

Miguel Sousa Lobo (Contact Author)

INSEAD - Decision Sciences ( email )

United States

Dai Yao

The Hong Kong Polytechnic University ( email )

Li Ka Shing Tower
The Hong Kong Polytechnic University
Hong Kong, Hung Hom, Kowloon M827
China
+852 27667143 (Phone)

HOME PAGE: http://www.yaod.ai

Do you have a job opening that you would like to promote on SSRN?

Paper statistics

Downloads
111
Abstract Views
1,039
Rank
375,458
PlumX Metrics