On the Sparsity of Mallows’ Model Averaging Estimator
12 Pages Posted: 25 Jul 2019 Last revised: 29 Jul 2019
Date Written: July 23, 2019
Abstract
We show that Mallows' model averaging estimator proposed by Hansen (2007) can be written as a least squares estimation with a weighted L1 penalty and additional constraints. By exploiting this representation, we demonstrate that the weight vector obtained by this model averaging procedure has a sparsity property in the sense that a subset of models receives exactly zero weights. Moreover, this representation allows us to adapt algorithms developed to efficiently solve minimization problems with many parameters and weighted L1 penalty. In particular, we develop a new coordinate-wise descent algorithm for model averaging. Simulation studies show that the new algorithm computes the model averaging estimator much faster and requires less memory than conventional methods when there are many models.
Keywords: sparsity, model averaging, $L_1$ penalty, coordinate-wise descent algorithm
JEL Classification: C51, C52
Suggested Citation: Suggested Citation