Big Data and Discrimination

29 Pages Posted: 29 Jun 2018 Last revised: 2 Aug 2019

See all articles by Talia B. Gillis

Talia B. Gillis

Columbia Law School

Jann Spiess

Microsoft Research New England

Date Written: July 19, 2018

Abstract

The ability to distinguish between people in setting prices is often constrained by legal rules that aim to prevent discrimination. These legal requirements have developed focusing on human decision-making contexts, and so their effectiveness is challenged as pricing increasingly relies on intelligent algorithms that extract information from big data. In this paper, we bring together existing legal requirements with the structure of machine learning decision-making in order to identify tensions between old law and new methods and lay the ground for legal solutions. We argue that while automated pricing rules provide increased transparency, their complexity also limits the application of existing law. Using a simulation exercise based on real-world mortgage data to illustrate our arguments, we note that restricting the characteristics that the algorithm is allowed to use can have a limited effect on disparity and can in fact increase pricing gaps. Second, we argue that there are limits to interpreting the pricing rules set by machine learning that hinders the application of existing discrimination laws. We end by discussing a framework for testing discrimination that evaluates algorithmic pricing rules in a controlled environment. Unlike the human decision-making context, this framework allows for ex-ante testing of price rules, facilitating comparisons between lenders.

Keywords: consumer finance, credit,discrimination,big data, personalized law, artificial intelligence, ECOA, FHA, CFPB

Suggested Citation

Gillis, Talia B. and Spiess, Jann, Big Data and Discrimination (July 19, 2018). 86 University of Chicago Law Review 459 (2019), Available at SSRN: https://ssrn.com/abstract=3204674

Talia B. Gillis (Contact Author)

Columbia Law School ( email )

435 W 116th Street
New York, NY 10027
United States

Jann Spiess

Microsoft Research New England ( email )

1 Memorial Dr
Cambridge, MA 02142
United States

HOME PAGE: http://www.microsoft.com/en-us/research/people/jaspiess/

Do you have a job opening that you would like to promote on SSRN?

Paper statistics

Downloads
591
Abstract Views
2,469
rank
54,430
PlumX Metrics