线性回归中基于自适应弹性网络S估计量的稳健变量选择与估计

Robust variable selection and estimation via adaptive elastic net S-estimators for linear regression

Computational Statistics and Data Analysis · 2023
被引 24 · 同刊同年前 3%
ABS 3

中文导读

提出自适应PENSE方法,在高维回归中应对重尾误差和异常值,实现稳健的变量选择和系数估计,并具有oracle性质。

Abstract

Heavy-tailed error distributions and predictors with anomalous values are ubiquitous in high-dimensional regression problems and can seriously jeopardize the validity of statistical analyses if not properly addressed. For more reliable variable selection and prediction under these adverse conditions, adaptive PENSE, a new robust regularized regression estimator, is proposed. Adaptive PENSE yields reliable variable selection and coefficient estimates even under aberrant contamination in the predictors or residuals. It is shown that the adaptive penalty leads to more robust and reliable variable selection than other penalties, particularly in the presence of gross outliers in the predictor space. It is further demonstrated that adaptive PENSE has strong variable selection properties and that it possesses the oracle property even under heavy-tailed errors and without the need to estimate the error scale. Numerical studies on simulated and real data sets highlight the superior finite-sample performance in a vast range of settings compared to other robust regularized estimators in the case of contaminated samples. An R package implementing a fast algorithm for computing the proposed method and additional simulation results are provided in the supplementary materials.

高维回归稳健统计变量选择弹性网络正则化