The Landscape and Gaps in Open Source Fairness Toolkits

Michelle Seng Ah Lee and Jatinder Singh. 2021. The Landscape and Gaps in Open Source Fairness Toolkits. In CHI Conference on Human Factors in Computing Systems (CHI ’21), May 8–13, 2021, Yokohama, Japan. ACM, Yokohama, Japan, 13 pages. https://doi.org/10.1145/3411764.3445261

13 Pages Posted: 23 Nov 2020 Last revised: 21 May 2021

See all articles by Michelle Seng Ah Lee

Michelle Seng Ah Lee

University of Cambridge

Jatinder Singh

University of Cambridge -- Dept. Computer Science & Technology (Computer Laboratory)

Date Written: September 18, 2020

Abstract

With the surge in literature focusing on the assessment and mitigation of unfair outcomes in algorithms, several open source 'fairness toolkits' recently emerged to make such methods widely accessible. However, little studied are the differences in approach and capabilities of existing fairness toolkits, and whether they are fit-for-purpose in commercial contexts. Towards this, this paper identifies the gaps between the existing open source fairness toolkit capabilities and the industry practitioners' needs. Specifically, we undertake a comparative assessment of the strengths and weaknesses of six prominent open source fairness toolkits, and investigate the current landscape and gaps in fairness toolkits through an exploratory focus group, a semi-structured interview, and an anonymous survey of data science/machine learning (ML) practitioners. We identify several gaps between the toolkits' capabilities and practitioner needs, highlighting areas requiring attention and future directions towards tooling that better support 'fairness in practice'.

Keywords: open source, fairness, fairness toolkits, algorithmic fairness, algorithmic auditing

Suggested Citation

Lee, Michelle Seng Ah and Singh, Jatinder, The Landscape and Gaps in Open Source Fairness Toolkits (September 18, 2020). Michelle Seng Ah Lee and Jatinder Singh. 2021. The Landscape and Gaps in Open Source Fairness Toolkits. In CHI Conference on Human Factors in Computing Systems (CHI ’21), May 8–13, 2021, Yokohama, Japan. ACM, Yokohama, Japan, 13 pages. https://doi.org/10.1145/3411764.3445261, Available at SSRN: https://ssrn.com/abstract=3695002 or http://dx.doi.org/10.2139/ssrn.3695002

Michelle Seng Ah Lee (Contact Author)

University of Cambridge ( email )

15 JJ Thomson Ave
William Gates Building
Cambridge, Cambridgeshire CB3 0FD
United Kingdom

HOME PAGE: http://compacctsys.soc.srcf.net/team/

Jatinder Singh

University of Cambridge -- Dept. Computer Science & Technology (Computer Laboratory) ( email )

15 JJ Thomson Avenue
William Gates Building
Cambridge, CB3 0FD
United Kingdom

Do you have a job opening that you would like to promote on SSRN?

Paper statistics

Downloads
571
Abstract Views
1,515
rank
58,961
PlumX Metrics