Optimal Sparse Sliced Inverse Regression via Random Projection
针对高维小样本数据,提出一种基于随机投影的稀疏切片逆回归方法,通过广义特征值分解实现高效计算,理论上达到极小化最优收敛速率,数值实验优于现有方法。
Given continuously emerging features, sufficient dimension reduction has been widely used as a supervised dimension reduction approach. Most existing high-dimensional sufficient dimension reduction methods involve penalized schemes, resulting in cumbersome tuning. To settle this problem, we propose a novel sparse sliced inverse regression method for sufficient dimension reduction based on random projections in a large p small n setting. Embedded in a generalized eigenvalue framework, the proposed approach finally reduces to parallel execution of low-dimensional (generalized) eigenvalue decompositions, which facilitates high computational efficiency. Theoretically, we prove that this method achieves the minimax optimal rate of convergence under suitable assumptions. Furthermore, our algorithm involves a delicate reweighting scheme, which can significantly enhance the identifiability of the active set of covariates. Extensive numerical experiments demonstrate high superiority of the proposed algorithm in comparison to competing methods. Supplementary materials for this article are available online.