关于超高维无模型特征选择的边际切片逆回归

On marginal sliced inverse regression for ultrahigh dimensional model-free feature selection

Annals of Statistics · 2016
被引 30
ABS 4★

中文导读

提出一种边际切片逆回归方法,用于超高维数据中的无模型特征选择,通过Dantzig选择子和稀疏精度矩阵估计实现变量选择一致性,并在模拟和实际数据中验证效果。

Abstract

Model-free variable selection has been implemented under the sufficient dimension reduction framework since the seminal paper of Cook [Ann. Statist. 32 (2004) 1062–1092]. In this paper, we extend the marginal coordinate test for sliced inverse regression (SIR) in Cook (2004) and propose a novel marginal SIR utility for the purpose of ultrahigh dimensional feature selection. Two distinct procedures, Dantzig selector and sparse precision matrix estimation, are incorporated to get two versions of sample level marginal SIR utilities. Both procedures lead to model-free variable selection consistency with predictor dimensionality $p$ diverging at an exponential rate of the sample size $n$. As a special case of marginal SIR, we ignore the correlation among the predictors and propose marginal independence SIR. Marginal independence SIR is closely related to many existing independence screening procedures in the literature, and achieves model-free screening consistency in the ultrahigh dimensional setting. The finite sample performances of the proposed procedures are studied through synthetic examples and an application to the small round blue cell tumors data.

特征选择切片逆回归降维高维统计无模型方法