Algorithmic governance and social vulnerability: a value analysis of equality and trust

Abstract

Amidst the continuous development and implementation of emerging digital technologies across all spheres of life, the public governance sphere is no exception. However, as the instances of algorithmic governance implementation accumulate in a quest to increase efficiency and cut costs, so do the instances of mistakes and downright political scandals. Notably, most of these scandals concern socially vulnerable citizens, whether due to being disproportionally targeted by algorithmic governance, or due to biased algorithm outcomes known to deepen the existing historical inequalities. This chapter presents a value analysis of equality and trust using cautionary examples of algorithmic governance that threaten these public values. The chapter uses experimentation as a conceptual lens to address the antecedents and consequences of the premature implementation of algorithmic governance targeting disproportionally socially vulnerable individuals and communities. The use of algorithmic governance before enough is known about the potential ill effects is tantamount to experimentation, and the potential harms from being targeted for testing such systems are disproportionately consequential for vulnerable populations, in economic and public value terms alike. The chapter concludes with a policy recommendation that strongly advises against the experimentation with algorithmic governance on vulnerable populations, because this deteriorates equality and trust-values that are already comparatively deprived among the socially vulnerable members of society. Therefore, as a moral obligation, social vulnerability should be considered a counterindication for the nascent use of algorithmic governance, particularly in the shape it tends to take currently-that of surveillance and control.
This article is part of the project ‘'The role and responsibilities of public actors in distributed networks’ (no. MVI.19.040) financed by the Dutch Research Council (NWO).

Keywords: algorithmic governance, algorithmic surveillance, equality and fairness, social and political trust, critical data studies