尖刺与平板LASSO

The Spike-and-Slab LASSO

Journal of the American Statistical Association · 2016
被引 345 · 同刊同年前 3%
ABS 4

中文导读

提出尖刺与平板LASSO方法,将贝叶斯变量选择与惩罚似然估计结合,通过非可分离惩罚函数实现自适应变量选择和参数估计,在模拟数据中表现接近最优。

Abstract

Despite the wide adoption of spike-and-slab methodology for Bayesian variable selection, its potential for penalized likelihood estimation has largely been overlooked. In this article, we bridge this gap by cross-fertilizing these two paradigms with the Spike-and-Slab LASSO procedure for variable selection and parameter estimation in linear regression. We introduce a new class of self-adaptive penalty functions that arise from a fully Bayes spike-and-slab formulation, ultimately moving beyond the separable penalty framework. A virtue of these nonseparable penalties is their ability to borrow strength across coordinates, adapt to ensemble sparsity information and exert multiplicity adjustment. The Spike-and-Slab LASSO procedure harvests efficient coordinate-wise implementations with a path-following scheme for dynamic posterior exploration. We show on simulated data that the fully Bayes penalty mimics oracle performance, providing a viable alternative to cross-validation. We develop theory for the separable and nonseparable variants of the penalty, showing rate-optimality of the global mode as well as optimal posterior concentration when p > n. Supplementary materials for this article are available online.

贝叶斯统计变量选择惩罚似然估计线性回归