A generalised ROC curve

48 Pages Posted: 12 Jul 2021

Date Written: July 9, 2021

Abstract

A key point to assess the application of statistical learning models in Artificial Intelligence (AI) is the evaluation of their predictive accuracy. This because the "automatic" choice of an action crucially depends on the made prediction. While the best model in terms of fit to the observed data can be chosen using a "universal" - and therefore automatable - criterion, based on the models' likelihood, such as AIC and BIC, this is not the case for the best model in terms of predictive accuracy. When the variable to be predicted is continuous, the most employed criterion is the root mean squared error whereas, when the response variable is binary, the most employed criterion is the area under the ROC curve. We propose to generalise the ROC curve to obtain a predictive model selection criterion that does not depend on the nature of the response variable.

Keywords: Artificial Intelligence, Predictive Accuracy, Receiver Operating Characteristic curve

JEL Classification: C18, C40, C52

Suggested Citation

Raffinetti, Emanuela and Giudici, Paolo, A generalised ROC curve (July 9, 2021). Available at SSRN: https://ssrn.com/abstract=3883422 or http://dx.doi.org/10.2139/ssrn.3883422

Emanuela Raffinetti (Contact Author)

University of Pavia ( email )

Via San Felice 5
Pavia, 27100
Italy

Paolo Giudici

University of Pavia ( email )

Via San Felice 7
27100 Pavia, 27100
Italy

Do you have a job opening that you would like to promote on SSRN?

Paper statistics

Downloads
176
Abstract Views
603
Rank
317,405
PlumX Metrics