Cognitive challenges in human-AI collaboration: Investigating the path towards productive delegation

Forthcoming, Information Systems Research

39 Pages Posted: 10 Apr 2019 Last revised: 16 Oct 2021

See all articles by Andreas Fügener

Andreas Fügener

University of Cologne

Jörn Grahl

University of Cologne

Alok Gupta

University of Minnesota - Twin Cities - Carlson School of Management

Wolfgang Ketter

University of Cologne - Faculty of Management, Economics and Social Sciences; Erasmus University Rotterdam (EUR) - Department of Technology and Operations Management; Erasmus Research Institute of Management (ERIM)

Date Written: April 8, 2019

Abstract

We study how humans make decisions when they collaborate with an artificial intelligence (AI): each instance of a classification task could be classified by themselves or by the AI. Experimental results suggest that humans and AI who work together can outperform the superior AI when it works alone. However, this only occurred when the AI delegated work to humans, not when humans delegated work to the AI. The AI profited, even from working with low-performing subjects, but humans did not delegate well. This bad delegation performance cannot be explained with algorithm aversion. On the contrary, subjects tried to follow a provided delegation strategy diligently and appeared to appreciate the AI support. However, human results suffered due to a lack of metaknowledge. They were not able to assess their own capabilities correctly, which in turn leads to poor delegation decisions. In contrast to reluctance to use AI, lacking metaknowledge
is an unconscious trait. It limits fundamentally how well human decision makers can collaborate with AI and other algorithms when there is no explicit performance feedback. The results have implications for the future of work, the design of human-AI collaborative environments and education in the digital age.

Keywords: Future of Work, Artificial Intelligence, Augemented Decision Environments, Deep Learning, Human-AI Collaboration, Machine Learning, Intelligent Software Agents

Suggested Citation

Fügener, Andreas and Grahl, Jörn and Gupta, Alok and Ketter, Wolfgang, Cognitive challenges in human-AI collaboration: Investigating the path towards productive delegation (April 8, 2019). Forthcoming, Information Systems Research, Available at SSRN: https://ssrn.com/abstract=3368813 or http://dx.doi.org/10.2139/ssrn.3368813

Andreas Fügener

University of Cologne ( email )

Albertus-Magnus-Platz
Cologne, 50923
Germany

Jörn Grahl

University of Cologne ( email )

Albertus-Magnus-Platz
Cologne, 50923
Germany

Alok Gupta

University of Minnesota - Twin Cities - Carlson School of Management ( email )

19th Avenue South
Minneapolis, MN 55455
United States

Wolfgang Ketter (Contact Author)

University of Cologne - Faculty of Management, Economics and Social Sciences ( email )

Albertus-Magnus-Platz
Cologne, 50923
Germany

HOME PAGE: http://is3.uni-koeln.de

Erasmus Research Institute of Management (ERIM) ( email )

P.O. Box 1738
3000 DR Rotterdam
Netherlands

HOME PAGE: http://www.rsm.nl/energy

Erasmus University Rotterdam (EUR) - Department of Technology and Operations Management ( email )

RSM Erasmus University
PO Box 1738
3000 DR Rotterdam
Netherlands

Do you have a job opening that you would like to promote on SSRN?

Paper statistics

Downloads
345
Abstract Views
2,700
rank
121,401
PlumX Metrics