Multivariate Regression Shrinkage and Selection by Canonical Correlation Analysis
31 Pages Posted: 23 Dec 2012
Date Written: December 23, 2012
Abstract
The problem of regression shrinkage and selection for multivariate regression is considered. The goal is to consistently identify those variables relevant for regression. This is done not only for predictors but also for responses. To this end, a novel relationship between multivariate regression and canonical correlation is discovered. Subsequently, its equivalent least squares type formulation is constructed, and then the well developed adaptive LASSO type penalty and also a novel BIC-type selection criterion can be directly applied. Theoretical results show that the resulting estimator is selection consistent for not only predictors but also responses. Numerical studies are presented to corroborate our theoretical findings.
Keywords: Adaptive Lasso, Canonical Correlation Analysis, Multivariate Regression, Selection Consistency, Tuning Parameter Selection
JEL Classification: C10, C13
Suggested Citation: Suggested Citation