Reviewable Automated Decision-Making

To appear in Computer Law & Security Review

6 Pages Posted:

See all articles by Jennifer Cobbe

Jennifer Cobbe

University of Cambridge - Computer Laboratory

Jatinder Singh

University of Cambridge -- Dept. Computer Science & Technology (Computer Laboratory)

Date Written: September 8, 2020

Abstract

In this paper we introduce the concept of ‘reviewability' as an alternative approach to improving the accountability of automated decision-making that involves machine learning systems. In doing so, we draw on an understanding of automated decision-making as a socio-technical process, involving both human (organisational) and technical components, beginning before a decision is made and extending beyond the decision itself. Although explanations for automated decisions may be useful in some contexts, they focus more narrowly on the model and therefore do not provide the information about that process as a whole that is necessary for many aspects of accountability, regulatory oversight, and assessments for legal compliance. Drawing on previous work on the application of administrative law and judicial review mechanisms to automated decision-making in the public sector, we argue that breaking down the automated decision-making process into its technical and organisational components allows us to consider how appropriate record-keeping and logging mechanisms implemented at each stage of that process would allow for the process as a whole to be reviewed. Although significant research is needed to explore how it can be implemented, we argue that a reviewability framework potentially offers for a more useful and more holistic form of accountability for automated decision-making than approaches focused more narrowly on explanations.

Keywords: automated decision-making; accountable systems; reviewability

Suggested Citation

Cobbe, Jennifer and Singh, Jatinder, Reviewable Automated Decision-Making (September 8, 2020). To appear in Computer Law & Security Review, Available at SSRN: https://ssrn.com/abstract=

Jennifer Cobbe (Contact Author)

University of Cambridge - Computer Laboratory ( email )

15 JJ Thomson Avenue
William Gates Building
Cambridge, CB3 0FD
United Kingdom

Jatinder Singh

University of Cambridge -- Dept. Computer Science & Technology (Computer Laboratory) ( email )

15 JJ Thomson Avenue
William Gates Building
Cambridge, CB3 0FD
United Kingdom

Here is the Coronavirus
related research on SSRN

Paper statistics

Downloads
15
Abstract Views
38
PlumX Metrics