Toward Robust Early-Warning Models: A Horse Race, Ensembles and Model Uncertainty

41 Pages Posted: 11 May 2016

See all articles by Markus Holopainen

Markus Holopainen

RiskLab Finland

Peter Sarlin

Hanken School of Economics; RiskLab Finland

Multiple version iconThere are 3 versions of this paper

Date Written: May 11, 2016

Abstract

This paper presents first steps toward robust models for crisis prediction. We conduct a horse race of conventional statistical methods and more recent machine learning methods as early-warning models. As individual models are in the literature most often built in isolation of other methods, the exercise is of high relevance for assessing the relative performance of a wide variety of methods. Further, we test various ensemble approaches to aggregating the information products of the built models, providing a more robust basis for measuring country-level vulnerabilities. Finally, we provide approaches to estimating model uncertainty in early-warning exercises, particularly model performance uncertainty and model output uncertainty. The approaches put forward in this paper are shown with Europe as a playground. Generally, our results show that the conventional statistical approaches are outperformed by more advanced machine learning methods, such as k-nearest neighbors and neural networks, and particularly by model aggregation approaches through ensemble learning.

Keywords: financial stability, early-warning models, horse race, ensembles, model uncertainty

JEL Classification: E44, F30, G01, G15, C43

Suggested Citation

Holopainen, Markus and Sarlin, Peter, Toward Robust Early-Warning Models: A Horse Race, Ensembles and Model Uncertainty (May 11, 2016). ECB Working Paper No. 1900, Available at SSRN: https://ssrn.com/abstract=2778530 or http://dx.doi.org/10.2139/ssrn.2778530

Markus Holopainen (Contact Author)

RiskLab Finland ( email )

Turku, 20520
Finland

Peter Sarlin

Hanken School of Economics

PO Box 479
FI-00101 Helsinki
Finland

RiskLab Finland ( email )

Turku, 20520
Finland

HOME PAGE: http://risklab.fi/people/peter/

Do you have negative results from your research you’d like to share?

Paper statistics

Downloads
136
Abstract Views
858
Rank
153,457
PlumX Metrics