Are the Unskilled Doomed to Remain Unaware? [The Extended Version]

41 Pages Posted: 31 Mar 2010  

Dmitry Ryvkin

Florida State University

Marian Krajc

Charles University in Prague - CERGE-EI (Center for Economic Research and Graduate Education - Economics Institute)

Andreas Ortmann

UNSW Australia Business School, School of Economics

Date Written: March 25, 2010

Abstract

The unskilled-and-unaware problem is a cognitive illusion resulting in a negative relationship between one's skill level and self-assessment bias: the less skilled are, on average, more unaware of the absolute and relative quality of their performance. In this paper, we study whether, and to what extent, the miscalibration (largely, overconfidence) of the unskilled can be reduced by feedback. We report the results of two studies, one in a natural setting and one in a more controlled setting, where subjects make incentivized judgments of their absolute and relative performance in various tasks and feedback conditions. In the first study, subjects improve their calibration after being exposed to naturally available information in the form of environmental feedback (i.e., feedback about the nature of the task) and calibration feedback (i.e., feedback about one's absolute and relative performance), but it is impossible to separate the effects of the two types of feedback. In the more controlled setting of the second study, we identified a positive effect of calibration feedback alone. In both studies, it is the unskilled who improve their calibration most. Our results suggest that the unskilled may not be doomed to be especially unaware. We also identify an important difference between the effects of feedback on the calibration of absolute and relative performance judgments. While the calibration of absolute performance judgments is more uniformly amenable to feedback, there appears to be a residual miscalibration of relative performance judgments by the unskilled that we attribute to self-image.

Keywords: calibration, judgment errors, unskilled, unaware, metacognition, self-image, experiment

Suggested Citation

Ryvkin, Dmitry and Krajc, Marian and Ortmann, Andreas, Are the Unskilled Doomed to Remain Unaware? [The Extended Version] (March 25, 2010). Available at SSRN: https://ssrn.com/abstract=1578474 or http://dx.doi.org/10.2139/ssrn.1578474

Dmitry Ryvkin (Contact Author)

Florida State University ( email )

Tallahassee, FL 30306-2180
United States

Marian Krajc

Charles University in Prague - CERGE-EI (Center for Economic Research and Graduate Education - Economics Institute) ( email )

Politickych veznu 7
Prague 1, 111 21
Czech Republic

HOME PAGE: http://www.cerge-ei.cz

Andreas Ortmann

UNSW Australia Business School, School of Economics ( email )

High Street
Sydney, NSW 2052
Australia

Paper statistics

Downloads
114
Rank
201,657
Abstract Views
1,000