Automation Bias in Public Administration - an Interdisciplinary Perspective From Law and Psychology

34 Pages Posted: 26 Mar 2024

See all articles by Hannah Ruschemeier

Hannah Ruschemeier

FernUniversität in Hagen

Lukas Hondrich

Fernuniversität in Hagen - University of Hagen

Date Written: February 23, 2024

Abstract

The objective of this paper is to break down the widely presumed dichotomy between fully automated decisions and human decisions from a psychological and normative perspective. We have investigated the phenomenon of automation bias, as a behavioral effect of and its implications in normative institutional decision-making situations. The phenomenon of automation bias, whereby individuals overly rely on machine-generated decisions or proposals, has far-reaching implications. Excessive reliance may result in a failure to meaningfully engage with the decision at hand, resulting in an inability to detect automation failures, and an overall deterioration in decision quality, potentially up to a net-negative impact of the decision support system. As legal systems emphasize the role of human decisions in ensuring fairness and quality, this paper critically examines the inadequacies of current EU and national legal frameworks in addressing the risks of automation bias. Contributing a novel perspective, this article integrates psychological, technical, and normative elements to analyze automation bias and its legal implications. Anchoring human decisions within legal principles, it navigates the intersections between AI and human-machine interactions from a normative point of view. An exploration of the AI Act sheds light on potential avenues for improvement. In conclusion, our paper proposes four steps aimed at effectively countering the potential perils posed by automation bias. By linking psychological insights, legal analysis, and technical implications, this paper advocates a holistic approach to evolving legal frameworks in an increasingly automated world.

Keywords: Legal theory, public administration, qualitative review, legal analysis, AI

Suggested Citation

Ruschemeier, Hannah and Hondrich, Lukas, Automation Bias in Public Administration - an Interdisciplinary Perspective From Law and Psychology (February 23, 2024). Available at SSRN: https://ssrn.com/abstract=4736646 or http://dx.doi.org/10.2139/ssrn.4736646

Hannah Ruschemeier (Contact Author)

FernUniversität in Hagen ( email )

Universitätsstrasse
Hagen, 58084
Germany

HOME PAGE: http://www.fernuni-hagen.de/prof-ruschemeier/en/

Lukas Hondrich

Fernuniversität in Hagen - University of Hagen ( email )

58084 Hagen
Germany

Do you have a job opening that you would like to promote on SSRN?

Paper statistics

Downloads
140
Abstract Views
624
Rank
441,176
PlumX Metrics