AI Audit Washing and Accountability

38 Pages Posted: 30 Sep 2022

See all articles by Ellen P. Goodman

Ellen P. Goodman

Rutgers Law

Julia Trehu

German Marshall Fund of the United States (GMF)

Date Written: September 22, 2022

Abstract

Algorithmic decision systems, many using artificial intelligence, are reshaping the provision of private and public services across the globe. There is an urgent need for algorithmic governance. Jurisdictions are adopting or considering mandatory audits of these systems to assess compliance with legal and ethical standards or to provide assurance that the systems work as advertised. The hope is that audits will make public agencies and private firms accountable for the harms their algorithmic systems may cause, and thereby lead to harm reductions and more ethical tech. This hope will not be realized so long as the existing ambiguity around the term “audit” persists, and until audit standards are adequate and well-understood. The tacit expectation that algorithmic audits will function like established financial audits or newer human rights audits is fanciful at this stage. In the European Union, where algorithmic audit requirements are most advanced, to the United States, where they are nascent, core questions need to be addressed for audits to become reliable AI accountability mechanisms. In the absence of greater specification and more independent auditors, the risk is that AI auditing becomes AI audit washing. This paper first reports on proposed and enacted transatlantic AI or algorithmic audit provisions. It then draws on the technical, legal, and sociotechnical literature to address the who, what, why, and how of algorithmic audits, contributing to the literature advancing algorithmic governance.

Keywords: AI, algorithms, audits, technology, ethics, ethical algorithms, governance, DSA

Suggested Citation

Goodman, Ellen P. and Trehu, Julia, AI Audit Washing and Accountability (September 22, 2022). Available at SSRN: https://ssrn.com/abstract=4227350 or http://dx.doi.org/10.2139/ssrn.4227350

Ellen P. Goodman (Contact Author)

Rutgers Law ( email )

217 N. 5th Street
Camden, NJ 08102
United States
856-225-6393 (Phone)
856-225-6516 (Fax)

Julia Trehu

German Marshall Fund of the United States (GMF)

Do you have negative results from your research you’d like to share?

Paper statistics

Downloads
610
Abstract Views
2,363
Rank
79,906
PlumX Metrics