稀疏偏最小二乘回归:同时实现降维和变量选择

Sparse Partial Least Squares Regression for Simultaneous Dimension Reduction and Variable Selection

Journal of the Royal Statistical Society. Series B: Statistical Methodology · 2010
被引 904
ABS 4

中文导读

针对高维小样本数据,提出稀疏偏最小二乘回归方法,同时实现降维和变量选择,并通过模拟和基因表达数据分析验证其性能。

Abstract

Partial least squares regression has been an alternative to ordinary least squares for handling multicollinearity in several areas of scientific research since the 1960s. It has recently gained much attention in the analysis of high dimensional genomic data. We show that known asymptotic consistency of the partial least squares estimator for a univariate response does not hold with the very large p and small n paradigm. We derive a similar result for a multivariate response regression with partial least squares. We then propose a sparse partial least squares formulation which aims simultaneously to achieve good predictive performance and variable selection by producing sparse linear combinations of the original predictors. We provide an efficient implementation of sparse partial least squares regression and compare it with well-known variable selection and dimension reduction approaches via simulation experiments. We illustrate the practical utility of sparse partial least squares regression in a joint analysis of gene expression and genomewide binding data.

偏最小二乘回归变量选择降维高维数据分析基因组学