深度神经网络协同监督的线性模型混合

Mixture of Linear Models Co-supervised by Deep Neural Networks

Journal of Computational and Graphical Statistics · 2022
被引 6
ABS 3

中文导读

提出一种混合线性模型方法,利用深度神经网络作为代理来估计,在保持较高预测精度的同时提高模型可解释性,适用于回归或分类任务。

Abstract

Deep neural networks (DNN) have been demonstrated to achieve unparalleled prediction accuracy in a wide range of applications. Despite its strong performance, in certain areas, the usage of DNN has met resistance because of its black-box nature. In this article, we propose a new method to estimate a mixture of linear models (MLM) for regression or classification that is relatively easy to interpret. We use DNN as a proxy of the optimal prediction function such that MLM can be effectively estimated. We propose visualization methods and quantitative approaches to interpret the predictor by MLM. Experiments show that the new method allows us to tradeoff interpretability and accuracy. The MLM estimated under the guidance of a trained DNN fills the gap between a highly explainable linear statistical model and a highly accurate but difficult to interpret predictor. Supplementary materials for this article are available online.

生物统计学机器学习人工智能统计学