Abstract

http://ssrn.com/abstract=1613452
 
 

References (44)



 


 



Factor Profiling for Ultra High Dimensional Variable Selection


Hansheng Wang


Peking University - Guanghua School of Management

May 23, 2010


Abstract:     
We propose here a novel method of factor profiling (FP) for ultra high dimensional variable selection. The new method assumes that the correlation structure of the high dimensional data can be well represented by a set of low-dimensional latent factors (Fan et al., 2008). The latent factors can then be estimated consistently by eigenvalue-eigenvector decomposition. They should be profiled out subsequently from both the response and predictors. Such an operation is referred to as FP. Obviously, FP produces uncorrelated predictors. Thereafter, the method of sure independent screening (Fan and Lv, 2008, SIS) can be applied immediately. This leads to profiled independent screening (PIS). PIS is shown to be selection consistent, even if the predictor dimension is substantially larger than the sample size. To further improve PIS, a novel method of profiled sequential screening (PSS) is proposed. PSS shares similar strength as forward regression (Wang, 2009a) but is computationally even simpler. Numerical studies are presented to corroborate our theoretical findings.

Number of Pages in PDF File: 44

Keywords: Bayesian Information Criterion, Factor Profiling, Forward Regression, Maximum Eigenvalue Ratio Criterion, Profiled Independent Screening, Profled Sequential Screening, Selection Consistency, Screening Consistency

JEL Classification: C10, C13

working papers series


Download This Paper

Date posted: May 23, 2010  

Suggested Citation

Wang, Hansheng, Factor Profiling for Ultra High Dimensional Variable Selection (May 23, 2010). Available at SSRN: http://ssrn.com/abstract=1613452 or http://dx.doi.org/10.2139/ssrn.1613452

Contact Information

Hansheng Wang (Contact Author)
Peking University - Guanghua School of Management ( email )
Peking University
Beijing, Beijing 100871
China
HOME PAGE: http://hansheng.gsm.pku.edu.cn
Feedback to SSRN


Paper statistics
Abstract Views: 1,676
Downloads: 499
Download Rank: 30,391
References:  44

© 2014 Social Science Electronic Publishing, Inc. All Rights Reserved.  FAQ   Terms of Use   Privacy Policy   Copyright   Contact Us
This page was processed by apollo5 in 0.265 seconds