Bias and Productivity in Humans and Machines

Upjohn Institute Working Paper 19-309, 2019

Columbia Business School Research Paper Forthcoming

31 Pages Posted: 10 Aug 2019

See all articles by Bo Cowgill

Bo Cowgill

Columbia University - Columbia Business School

Multiple version iconThere are 2 versions of this paper

Date Written: August 6, 2019

Abstract

Where should better learning technology (such as machine learning or AI) improve decisions? I develop a model of decision-making in which better learning technology is complementary with experimentation. Noisy, inconsistent decision-making introduces quasi-experimental variation into training datasets, which complements learning. The model makes heterogeneous predictions about when machine learning algorithms can improve human biases. These algorithms can remove human biases exhibited in historical training data, but only if the human training decisions are sufficiently noisy; otherwise, the algorithms will codify or exacerbate existing biases. Algorithms need only a small amount of noise to correct biases that cause large productivity distortions. As the amount of noise increases, the machine learning can correct both large and increasingly small productivity distortions. The theoretical conditions necessary to completely eliminate bias are extreme and unlikely to appear in real datasets. The model provides theoretical microfoundations for why learning from biased historical datasets may lead to a decrease (if not a full elimination) of bias, as has been documented in several empirical settings. The model makes heterogeneous predictions about the use of human expertise in machine learning. Expert-labeled training datasets may be suboptimal if experts are insufficiently noisy, as prior research suggests. I discuss implications for regulation, labor markets, and business strategy.

Keywords: machine learning, training data, decision algorithm, decision-making, human biases

JEL Classification: C44, C45, D80; O31, O33

Suggested Citation

Cowgill, Bo, Bias and Productivity in Humans and Machines (August 6, 2019). Upjohn Institute Working Paper 19-309, 2019, Columbia Business School Research Paper Forthcoming, Available at SSRN: https://ssrn.com/abstract=3433737 or http://dx.doi.org/10.2139/ssrn.3433737

Bo Cowgill (Contact Author)

Columbia University - Columbia Business School ( email )

3022 Broadway
New York, NY 10027
United States

Do you have a job opening that you would like to promote on SSRN?

Paper statistics

Downloads
282
Abstract Views
1,654
Rank
43,736
PlumX Metrics