Exploring or Exploiting? Social and Ethical Implications of Autonomous Experimentation in AI

Workshop on Fairness, Accountability, and Transparency in Machine Learning, 2016

4 Pages Posted: 4 Oct 2016 Last revised: 13 Oct 2016

See all articles by Sarah Bird

Sarah Bird

Microsoft Corporation

Solon Barocas

Cornell University

Kate Crawford

AI Now Institute; Microsoft Research

Fernando Diaz

Microsoft Research

Hanna Wallach

Microsoft Research New York City

Date Written: October 2, 2016

Abstract

In the field of computer science, large-scale experimentation on users is not new. However, driven by advances in artificial intelligence, novel autonomous systems for experimentation are emerging that raise complex, unanswered questions for the field. Some of these questions are computational, while others relate to the social and ethical implications of these systems. We see these normative questions as urgent because they pertain to critical infrastructure upon which large populations depend, such as transportation and healthcare. Although experimentation on widely used online platforms like Facebook has stoked controversy in recent years, the unique risks posed by autonomous experimentation have not received sufficient attention, even though such techniques are being trialled on a massive scale. In this paper, we identify several questions about the social and ethical implications of autonomous experimentation systems. These questions concern the design of such systems, their effects on users, and their resistance to some common mitigations.

Keywords: Autonomous Experimentation, Artificial Intelligence, Privacy, Ethics

Suggested Citation

Bird, Sarah and Barocas, Solon and Crawford, Kate and Diaz, Fernando and Wallach, Hanna, Exploring or Exploiting? Social and Ethical Implications of Autonomous Experimentation in AI (October 2, 2016). Workshop on Fairness, Accountability, and Transparency in Machine Learning, 2016. Available at SSRN: https://ssrn.com/abstract=2846909

Sarah Bird

Microsoft Corporation ( email )

One Microsoft Way
Redmond, WA 98052
United States

Solon Barocas (Contact Author)

Cornell University ( email )

Ithaca, NY 14853
United States

Kate Crawford

AI Now Institute ( email )

60 5th Ave
8th floor
New York, NY New York 10011
United States

Microsoft Research ( email )

641 Avenue of the Americas
641 Avenue of the Americas, level 7
New York, NY NY 10011
United States

Fernando Diaz

Microsoft Research ( email )

641 Avenue of Americas
New York, NY 10011
United States

Hanna Wallach

Microsoft Research New York City ( email )

641 Avenue of Americas
New York, NY 10011
United States

Register to save articles to
your library

Register

Paper statistics

Downloads
1,586
rank
10,342
Abstract Views
6,150
PlumX Metrics
!

Under construction: SSRN citations while be offline until July when we will launch a brand new and improved citations service, check here for more details.

For more information