Human Rights Protection and High-Risk AI Systems: The Spanish Model in Gender-Based Violence Prevention

7 Pages Posted: 6 May 2022 Last revised: 17 May 2022

See all articles by Elena Falletti

Elena Falletti

Carlo Cattaneo - LIUC University

Date Written: April 16, 2022

Abstract

VioGén (Sistema de Seguimiento Integral en los casos de Violencia de Género) is a risk assessment software regulated by “Ley Orgánica 1/2004 de Medidas de Protección Integral contra la Violencia de Género”, and it applies to regulation in all reported gender-based violence situations, especially regarding intimate partners violence or violence against minors. It has been used in Spain since 2007, and it is designed to estimate the risk of occurrence of further violence after a previous complaint (police recidivism), taking into account risk and protective indicators which it can observe, in spite of its final users are not behavioral assessment experts.

Since it is a predictive software, VioGén could be considered a “high-risk AI systems” under the Annex III of the new “Proposal for AI Regulation” published by the European Commission on 21st April 2021.

Using risk assessment software like VioGén shows both positive and negative issues. On the one hand, VioGén allows developing strategies to reduce recidivism through the prediction of IPV risk. This stands out in a peculiar way because of the first-hand contact with victims and aggressors, in particular in family environments, where the protection of vulnerable subjects against life, personal integrity, and safety threats is essential for assuring peaceful relationships. On the other hand, risk assessment softwares shows relevant critical issues regarding the presumption of innocence of individuals, the presence of bias that the software can absorb from both data collected or machine learning proceedings.

The aim of this proposal is to analyse the relevant profiles using a risk assessment software like VioGén involved in human rights protection under both the Charter of Fundamental Rights of the European Union and the European Convention of Human Rights, focusing the balance on protection of dignity, right to life, to physical and mental integrity, protection of private and family life, non-discrimination and fair trial, for vulnerable subjects and on the other hand the protection of due process, presumption of innocence and non-discrimination for prospective defendants.

Keywords: Risk assessment software, Artificial Neural Network, Artificial Intelligence, Discrimination

JEL Classification: K36, K42

Suggested Citation

Falletti, Elena, Human Rights Protection and High-Risk AI Systems: The Spanish Model in Gender-Based Violence Prevention (April 16, 2022). Available at SSRN: https://ssrn.com/abstract=4085224 or http://dx.doi.org/10.2139/ssrn.4085224

Elena Falletti (Contact Author)

Carlo Cattaneo - LIUC University ( email )

Corso Matteotti 22
Castellanza, Varese 21053
Italy

Do you have a job opening that you would like to promote on SSRN?

Paper statistics

Downloads
19
Abstract Views
52
PlumX Metrics