🌙

强最优分类树

Strong Optimal Classification Trees

Operations Research · 2024
被引 23 · 同刊同年前 3%
人大 AFT50UTD24ABS 4*

中文导读

提出一种基于整数优化和多面体理论的强线性规划松弛方法,训练时间比现有最优方法快29%,样本外准确率提升8%。

Abstract

Decision trees are among the most interpretable and popular machine learning models that are used routinely in applications ranging from revenue management to medicine. Traditional heuristic methods, although fast, lack modeling flexibility for incorporating constraints such as fairness and do not guarantee optimality. Recent efforts aim to overcome these limitations using mixed-integer optimization (MIO) for better modeling flexibility and optimality, but speed remains an issue. In “Strong Optimal Classification Trees,” Aghaei, Gómez, and Vayanos use integer optimization and polyhedral theory to create an MIO-based formulation with a strong LO relaxation resulting in a 29% speed-up in training time compared with state-of-the-art MIO-based formulations, as well as up to an 8% improvement in out-of-sample accuracy.

机器学习整数优化决策树运筹学