The Unexpected Consequences of Automation in Policing

__S.M.U. L. Rev. __ (2022 Forthcoming)

30 Pages Posted: 1 Jun 2022

See all articles by Elizabeth E. Joh

Elizabeth E. Joh

University of California, Davis - School of Law

Date Written: May 19, 2022

Abstract

This essay has two aims. First, it explains how automated decisionmaking can produce unexpected results. This is a problem long understood in the field of industrial organization. To identify such effects in policing is no easy task. The police are a notoriously difficult institution to study. They are insular, dislike outsiders, and especially dislike critical outsiders. Fortunately, we have the benefit of a decade’s worth of experimentation in the police use of automated decisionmaking, and the resulting political backlash against some of these uses. As a result, some large urban police departments have undergone external investigations to see whether tools like predictive policing or individual criminal risk assessments are biased or ineffective or simply too costly in light of their benefits. One of these recent reports, on the use of acoustic gunshot detection software in Chicago, provides a window into one type of police automation.

This leads to the article’s second observation. Automation is not just a set of tools that the police use; it changes the environment of policing in unexpected ways. There are now some widely-known criticisms of the increasing use of automated tools in policing, but they focus primarily on the flaws of the technologies used. The training data in facial recognition algorithms may be biased along lines of race, gender, and ethnicity. Risk assessments for gun violence may in truth be poor guides for police intervention. These claims are singularly technology-focused. Accordingly, errors and inefficiencies merit technological improvements. Even calls for bans on technologies like facial recognition are responses to the technology itself. As Chicago’s experience with acoustic gunshot detection technology demonstrates, however, automation serves not just as a tool for the police, but also led to changes in police behavior. These changes in police conduct are documented in a 2021 report from the Chicago Office of Inspector General. And they are noteworthy. If automation unexpectedly changes police behaviors, these changes have implications for how we understand policing through the lens of inequality and unaccountability.

Keywords: gunshot detection, automation, technology, artificial intelligence, shotspotter, policing, law enforcement, AI, racial discrimination, discretion, criminal justice

JEL Classification: K14

Suggested Citation

Joh, Elizabeth E., The Unexpected Consequences of Automation in Policing (May 19, 2022). __S.M.U. L. Rev. __ (2022 Forthcoming), Available at SSRN: https://ssrn.com/abstract=4114909 or http://dx.doi.org/10.2139/ssrn.4114909

Elizabeth E. Joh (Contact Author)

University of California, Davis - School of Law ( email )

400 Mrak Hall Drive
Davis, CA 95616-5201
United States

Do you have a job opening that you would like to promote on SSRN?

Paper statistics

Downloads
161
Abstract Views
654
rank
266,962
PlumX Metrics