拉普拉斯先验下指数加权聚合的统计性质

On the exponentially weighted aggregate with the Laplace prior

Annals of Statistics · 2018
被引 14
ABS 4★

中文导读

研究了拉普拉斯先验下指数加权聚合在高维固定设计回归中的统计行为,建立了锐利预言不等式,证明其在预测损失上与套索估计量具有相同性质。

Abstract

In this paper, we study the statistical behaviour of the Exponentially Weighted Aggregate (EWA) in the problem of high-dimensional regression with fixed design. Under the assumption that the underlying regression vector is sparse, it is reasonable to use the Laplace distribution as a prior. The resulting estimator and, specifically, a particular instance of it referred to as the Bayesian lasso, was already used in the statistical literature because of its computational convenience, even though no thorough mathematical analysis of its statistical properties was carried out. The present work fills this gap by establishing sharp oracle inequalities for the EWA with the Laplace prior. These inequalities show that if the temperature parameter is small, the EWA with the Laplace prior satisfies the same type of oracle inequality as the lasso estimator does, as long as the quality of estimation is measured by the prediction loss. Extensions of the proposed methodology to the problem of prediction with low-rank matrices are considered.

高维回归稀疏估计贝叶斯套索预测损失