关于稀疏最优回归树的研究

On sparse optimal regression trees

European Journal of Operational Research · 2021
被引 13
ABS 4

中文导读

将最优回归树建模为连续优化问题,在预测精度与局部和全局稀疏性之间寻求平衡,支持成本敏感性和公平性,并通过平滑预测提供连续变量的局部解释。实验表明,该方法在预测精度上优于CART、OLS和LASSO等标准方法,且具有良好的可扩展性。

Abstract

In this paper, we model an optimal regression tree through a continuous optimization problem, where a compromise between prediction accuracy and both types of sparsity, namely local and global, is sought. Our approach can accommodate important desirable properties for the regression task, such as cost-sensitivity and fairness. Thanks to the smoothness of the predictions, we can derive local explanations on the continuous predictor variables. The computational experience reported shows the outperformance of our approach in terms of prediction accuracy against standard benchmark regression methods such as CART, OLS and LASSO. Moreover, the scalability of our approach with respect to the size of the training sample is illustrated.

机器学习回归分析优化方法可解释性