Interactive Tree-Structured Regression via Principal Hessian Directions
提出一种交互式树结构回归方法，通过主曲率方向寻找回归曲面弯曲最大的方向来递归分割数据，直到各区域线性拟合合适，并与CART等方法比较，突出几何信息的优势。
Abstract An interactive approach to tree-structured regression is introduced. Unlike other procedures driven by cost optimization, this approach focuses on the exploration of geometric information in the data. The procedure begins with finding a direction along which the regression surface bends the most. This direction is used for splitting the data into two regions. Within each region, another direction is found, and the partition is made in the same manner. The process continues recursively until the entire regressor domain is decomposed into regions wherein the surface no longer bends significantly and linear regression fit becomes appropriate. For implementing the direction search, the method of principal Hessian directions is applied. Several simulation and empirical results are reported. Comparison with three methods—CART, SUPPORT, and MARS—is made. The benefit of using geometric information is highlighted.