Auditing Algorithms for Discrimination

16 Pages Posted: 30 Dec 2017

See all articles by Pauline Kim

Pauline Kim

Washington University in St. Louis - School of Law

Date Written: December 17, 2017

Abstract

This Essay responds to the argument by Joshua Kroll, et al., in Accountable Algorithms, 165 U.PA.L.REV. 633 (2017), that technical tools can be more effective in ensuring the fairness of algorithms than insisting on transparency. When it comes to combating discrimination, technical tools alone will not be able to prevent discriminatory outcomes. Because the causes of bias often lie, not in the code, but in broader social processes, techniques like randomization or predefining constraints on the decision-process cannot guarantee the absence of bias. Even the most carefully designed systems may inadvertently encode preexisting prejudices or reflect structural bias. For this reason, avoiding discrimination requires not only attention to fairness in design, but also scrutiny of how these systems operate in practice. Only by observing actual outcomes is it possible to determine whether there are discriminatory effects, and therefore, auditing must remain an important part of the strategy. Fortunately, the law permits the use of auditing to detect and correct for discriminatory bias. To the extent that Kroll et al. suggest otherwise, their conclusion rests on a misreading of the Supreme Court’s decision in Ricci v. DeStefano. That case narrowly addressed a situation in which an employer took an adverse action against identifiable individuals based on race, but the law still permits the revision of algorithms prospectively to remove bias. Such an approach is entirely consistent with the law’s clear preference for voluntary efforts to comply with nondiscrimination goals.

Suggested Citation

Kim, Pauline, Auditing Algorithms for Discrimination (December 17, 2017). 166 U. Pa. L. rev. Online 189 (2017); Washington University in St. Louis Legal Studies Research Paper No. 17-12-03. Available at SSRN: https://ssrn.com/abstract=3093982

Pauline Kim (Contact Author)

Washington University in St. Louis - School of Law ( email )

Campus Box 1120
St. Louis, MO 63130
United States
314-935-8570 (Phone)
314-935-5356 (Fax)

Register to save articles to
your library

Register

Paper statistics

Downloads
237
Abstract Views
879
rank
130,548
PlumX Metrics