可扩展的贝叶斯变量选择与模型平均算法:基于块对角Gram矩阵的精确推断与启发式探索

OUP accepted manuscript

Biometrika · 2017
被引 8
ABS 4

中文导读

提出一种可扩展算法,在Gram矩阵块对角假设下实现精确贝叶斯变量选择与模型平均,无需数值积分即可返回任意大小的最可能模型,计算成本随块数线性增长,适用于预测变量按中等大小块组织的情形。

Abstract

We propose a scalable algorithmic framework for exact Bayesian variable selection and model averaging in linear models under the assumption that the Gram matrix is block-diagonal, and as a heuristic for exploring the model space for general designs. In block-diagonal designs our approach returns the most probable model of any given size without resorting to numerical integration. The algorithm also provides a novel and efficient solution to the frequentist best subset selection problem for block-diagonal designs. Posterior probabilities for any number of models are obtained by evaluating a single one-dimensional integral, and other quantities of interest such as variable inclusion probabilities and model-averaged regression estimates are obtained by an adaptive, deterministic one-dimensional numerical integration. The overall computational cost scales linearly with the number of blocks, which can be processed in parallel, and exponentially with the block size, rendering it most adequate in situations where predictors are organized in many moderately-sized blocks. For general designs, we approximate the Gram matrix by a block-diagonal matrix using spectral clustering and propose an iterative algorithm that capitalizes on the block-diagonal algorithms to explore efficiently the model space. All methods proposed in this paper are implemented in the R library mombf.

贝叶斯统计变量选择模型平均计算统计线性模型