The Institutional Life of Algorithmic Risk Assessment

30 Pages Posted: 24 Jun 2019

See all articles by Alicia Solow-Niederman

Alicia Solow-Niederman

affiliation not provided to SSRN

YooJung Choi

University of California, Los Angeles (UCLA) - Computer Science Department

Guy Van den Broeck

UCLA Department of Computer Science

Date Written: June 18, 2019

Abstract

As states nationwide increasingly turn to risk assessment algorithms as tools for criminal justice reform, scholars and civil society actors alike are increasingly warning that this technological turn comes with complications. Research to date tends to focus on fairness, accountability, and transparency within algorithmic tools. Although attention to whether these instruments are fair or biased is normatively essential, this Article contends that this inquiry cannot be the whole conversation. Looking at issues such as fairness or bias in a tool in isolation elides vital bigger-picture considerations about the institutions and political systems within which tools are developed and deployed. Using California’s Money Bail Reform Act of 2017 (SB 10) as an example, this Article analyzes how risk assessment statutes create frameworks within which policymakers and technical actors are constrained and empowered when it comes to the design and implementation of a particular instrument. Specifically, it focuses on the tension between, on one hand, a top-down, global understanding of fairness, accuracy, and lack of bias and, on the other, a tool that is well-tailored to local considerations. It explores three potential technical and associated policy consequences of SB 10’s framework: proxies, Simpson’s paradox, and thresholding. And it calls for greater attention to the design of risk assessment statutes and their allocation of global and local authority.

Keywords: Machine Learning, Technology, Law, Criminal Justice, Algorithm, Risk Assessment

Suggested Citation

Solow-Niederman, Alicia and Choi, YooJung and Van den Broeck, Guy, The Institutional Life of Algorithmic Risk Assessment (June 18, 2019). Berkeley Technology Law Journal, Forthcoming. Available at SSRN: https://ssrn.com/abstract=3405716

Alicia Solow-Niederman (Contact Author)

affiliation not provided to SSRN

YooJung Choi

University of California, Los Angeles (UCLA) - Computer Science Department ( email )

404 Westwood Plaza
Los Angeles, CA 90095
United States

Guy Van den Broeck

UCLA Department of Computer Science ( email )

405 Hilgard Avenue
Box 951361
Los Angeles, CA 90095
United States

Register to save articles to
your library

Register

Paper statistics

Downloads
49
Abstract Views
364
PlumX Metrics