🌙

GP-BART: 一种使用高斯过程的新型贝叶斯加性回归树方法

GP-BART: A novel Bayesian additive regression trees approach using Gaussian processes

Computational Statistics and Data Analysis · 2023
被引 8
ABS 3

中文导读

提出GP-BART模型,通过为每棵树的终端节点预测引入高斯过程先验,解决标准BART缺乏平滑性和协方差结构的问题,在模拟和真实数据上表现优于传统方法。

Abstract

The Bayesian additive regression trees (BART) model is an ensemble method extensively and successfully used in regression tasks due to its consistently strong predictive performance and its ability to quantify uncertainty. BART combines “weak” tree models through a set of shrinkage priors, whereby each tree explains a small portion of the variability in the data. However, the lack of smoothness and the absence of an explicit covariance structure over the observations in standard BART can yield poor performance in cases where such assumptions would be necessary. The Gaussian processes Bayesian additive regression trees (GP-BART) model is an extension of BART which addresses this limitation by assuming Gaussian process (GP) priors for the predictions of each terminal node among all trees. The model's effectiveness is demonstrated through applications to simulated and real-world data, surpassing the performance of traditional modeling approaches in various scenarios.

贝叶斯统计机器学习回归分析高斯过程