Retooling Poverty Targeting Using Out-of-Sample Validation and Machine Learning

Abstract

Proxy means test (PMT) poverty targeting tools have become common tools for beneficiary targeting and poverty assessment where full means tests are costly. Currently popular estimation procedures for generating these tools prioritize minimization of in-sample prediction errors; however, the objective in generating such tools is out-of-sample prediction. This paper presents evidence that prioritizing minimal out-of-sample error, identified through cross-validation and stochastic ensemble methods, in PMT tool development can substantially improve the out-of-sample performance of these targeting tools. The USAID poverty assessment tool and base data are used for demonstration of these methods; however, the methods applied in this paper should be considered for PMT and other poverty-targeting tool development more broadly.

Keywords: Small Area Estimation Poverty Mapping, Poverty Impact Evaluation, Poverty Monitoring & Analysis, Poverty Assessment, Poverty Lines, Poverty Diagnostics