Procurement As Policy: Administrative Process for Machine Learning

78 Pages Posted: 15 Oct 2019 Last revised: 9 Dec 2019

See all articles by Deirdre K. Mulligan

Deirdre K. Mulligan

University of California, Berkeley - School of Information

Kenneth A. Bamberger

University of California, Berkeley - School of Law

Date Written: October 4, 2019

Abstract

At every level of government, officials contract for technical systems that employ machine learning—systems that perform tasks without using explicit instructions, relying on patterns and inference instead. These systems frequently displace discretion previously exercised by policymakers or individual front-end government employees with an opaque logic that bears no resemblance to the reasoning processes of agency personnel. However, because agencies acquire these systems through government procurement processes, they and the public have little input into—or even knowledge about—their design or how well that design aligns with public goals and values.

This Article explains the ways that the decisions about goals, values, risk, and certainty, along with the elimination of case-by-case discretion, inherent in machine-learning system design create policies—not just once when they are designed, but over time as they adapt and change. When the adoption of these systems is governed by procurement, the policies they embed receive little or no agency or outside expertise beyond that provided by the vendor. Design decisions are left to private third-party developers. There is no public participation, no reasoned deliberation, and no factual record, which abdicates Government responsibility for policymaking.

This Article then argues for a move from a procurement mindset to policymaking mindset. When policy decisions are made through system design, processes suitable for substantive administrative determinations should be used: processes that foster deliberation reflecting both technocratic demands for reason and rationality informed by expertise, and democratic demands for public participation and political accountability. Specifically, the Article proposes administrative law as the framework to guide the adoption of machine learning governance, describing specific ways that the policy choices embedded in machine-learning system design fail the prohibition against arbitrary and capricious agency actions absent a reasoned decision-making process that both enlists the expertise necessary for reasoned deliberation about, and justification for, such choices, and makes visible the political choices being made.

Finally, this Article sketches models for machine-learning adoption processes that satisfy the prohibition against arbitrary and capricious agency actions. It explores processes by which agencies might garner technical expertise and overcome problems of system opacity, satisfying administrative law’s technocratic demand for reasoned expert deliberation. It further proposes both institutional and engineering design solutions to the challenge of policymaking opacity, offering process paradigms to ensure the “political visibility” required for public input and political oversight. In doing so, it also proposes the importance of using “contestable design”—design that exposes value-laden features and parameters and provides for iterative human involvement in system evolution and deployment. Together, these institutional and design approaches further both administrative law’s technocratic and democratic mandates.

Keywords: Artificial Intelligence, Machine Learning, Administrative Process, Policy, Regulation, Technology, Administrative Law, Arbitrary and Capricious Review, Procurement

JEL Classification: K2, K23, K42, L50, O30, O31, O33, O38

Suggested Citation

Mulligan, Deirdre K. and Bamberger, Kenneth A., Procurement As Policy: Administrative Process for Machine Learning (October 4, 2019). Berkeley Technology Law Journal, Vol. 34, 2019, Available at SSRN: https://ssrn.com/abstract=3464203 or http://dx.doi.org/10.2139/ssrn.3464203

Deirdre K. Mulligan

University of California, Berkeley - School of Information ( email )

102 South Hall
Berkeley, CA 94720-4600
United States

Kenneth A. Bamberger (Contact Author)

University of California, Berkeley - School of Law ( email )

Boalt Hall NA446
Berkeley, CA 94720-7200
United States
(510) 643-6218 (Phone)

HOME PAGE: http://www.law.berkeley.edu/faculty/profiles/facultyProfile.php?facID=5701

Do you have a job opening that you would like to promote on SSRN?

Paper statistics

Downloads
1,032
Abstract Views
7,563
Rank
44,117
PlumX Metrics