高维混合专家模型的预测集

Prediction sets for high-dimensional mixture of experts models

Journal of the Royal Statistical Society. Series B: Statistical Methodology · 2024
被引 2
ABS 4

中文导读

研究了如何在高维混合线性专家模型中构建有效的预测集,通过去偏方法处理惩罚带来的偏差,并提出组合区间的新策略,确保覆盖保证。

Abstract

Abstract Large datasets make it possible to build predictive models that can capture heterogenous relationships between the response variable and features. The mixture of high-dimensional linear experts model posits that observations come from a mixture of high-dimensional linear regression models, where the mixture weights are themselves feature-dependent. In this article, we show how to construct valid prediction sets for an ℓ1-penalized mixture of experts model in the high-dimensional setting. We make use of a debiasing procedure to account for the bias induced by the penalization and propose a novel strategy for combining intervals to form a prediction set with coverage guarantees in the mixture setting. Synthetic examples and an application to the prediction of critical temperatures of superconducting materials show our method to have reliable practical performance.

高维统计混合模型预测建模机器学习