Through a Glass, Darkly: Artificial Intelligence and the Problem of Opacity

Forthcoming, American Journal of Comparative Law

NUS Law Working Paper No. 2020/011

27 Pages Posted: 14 Apr 2020 Last revised: 20 Apr 2020

See all articles by Simon Chesterman

Simon Chesterman

National University of Singapore (NUS) - Faculty of Law

Date Written: April 1, 2020

Abstract

As computer programs become more complex, the ability of non-specialists to understand how a given output has been reached diminishes. Opaqueness may also be built into programs to protect proprietary interests. Both types of system are capable of being explained, either through recourse to experts or an order to produce information. Another class of system may be naturally opaque, however, using deep learning methods that are impossible to explain in a manner that humans can comprehend. An emerging literature describes these phenomena or specific problems to which they give rise, notably the potential for bias against specific groups. Drawing on examples from the United States, the European Union, and China, this article develops a novel typology of three discrete regulatory challenges posed by opacity. First, it may encourage — or fail to discourage — inferior decisions by removing the potential for oversight and accountability. Secondly, it may allow impermissible decisions, notably those that explicitly or implicitly rely on protected categories such as gender or race in making a determination. Thirdly, it may render illegitimate decisions in which the process by which an answer is reached is as important as the answer itself. The means of addressing some or all of these concerns is routinely said to be through transparency. Yet while proprietary opacity can be dealt with by court order and complex opacity through recourse to experts, naturally opaque systems may require novel forms of ‘explanation’ or an acceptance that some machine-made decisions cannot be explained — or, in the alternative, that some decisions should not be made by machine at all.

Keywords: Artificial Intelligence, Regulation, Technology, Criminal Law, Public Law, Opacity, Comparative Law

JEL Classification: K24, O32, O34, O38

Suggested Citation

Chesterman, Simon, Through a Glass, Darkly: Artificial Intelligence and the Problem of Opacity (April 1, 2020). Forthcoming, American Journal of Comparative Law, NUS Law Working Paper No. 2020/011, Available at SSRN: https://ssrn.com/abstract=3575534 or http://dx.doi.org/10.2139/ssrn.3575534

Simon Chesterman (Contact Author)

National University of Singapore (NUS) - Faculty of Law ( email )

469G Bukit Timah Road
Eu Tong Sen Building
Singapore, 259776
Singapore

HOME PAGE: www.SimonChesterman.com

Here is the Coronavirus
related research on SSRN

Paper statistics

Downloads
160
Abstract Views
899
rank
204,706
PlumX Metrics