References (44)



Factor Profiling for Ultra High Dimensional Variable Selection

Hansheng Wang

Peking University - Guanghua School of Management

May 23, 2010

We propose here a novel method of factor profiling (FP) for ultra high dimensional variable selection. The new method assumes that the correlation structure of the high dimensional data can be well represented by a set of low-dimensional latent factors (Fan et al., 2008). The latent factors can then be estimated consistently by eigenvalue-eigenvector decomposition. They should be profiled out subsequently from both the response and predictors. Such an operation is referred to as FP. Obviously, FP produces uncorrelated predictors. Thereafter, the method of sure independent screening (Fan and Lv, 2008, SIS) can be applied immediately. This leads to profiled independent screening (PIS). PIS is shown to be selection consistent, even if the predictor dimension is substantially larger than the sample size. To further improve PIS, a novel method of profiled sequential screening (PSS) is proposed. PSS shares similar strength as forward regression (Wang, 2009a) but is computationally even simpler. Numerical studies are presented to corroborate our theoretical findings.

Number of Pages in PDF File: 44

Keywords: Bayesian Information Criterion, Factor Profiling, Forward Regression, Maximum Eigenvalue Ratio Criterion, Profiled Independent Screening, Profled Sequential Screening, Selection Consistency, Screening Consistency

JEL Classification: C10, C13

Open PDF in Browser Download This Paper

Date posted: May 23, 2010  

Suggested Citation

Wang, Hansheng, Factor Profiling for Ultra High Dimensional Variable Selection (May 23, 2010). Available at SSRN: https://ssrn.com/abstract=1613452 or http://dx.doi.org/10.2139/ssrn.1613452

Contact Information

Hansheng Wang (Contact Author)
Peking University - Guanghua School of Management ( email )
Peking University
Beijing, Beijing 100871
HOME PAGE: http://hansheng.gsm.pku.edu.cn
Feedback to SSRN

Paper statistics
Abstract Views: 1,978
Downloads: 585
Download Rank: 33,440
References:  44