带极端阈值惩罚的双向截断线性回归模型

Two-Way Truncated Linear Regression Models with Extremely Thresholding Penalization

Journal of the American Statistical Association · 2022
被引 5
ABS 4

中文导读

提出一种双向截断线性回归模型,每个预测变量通过未知阈值进行条件截断,并引入与系数无关的极端阈值惩罚,能检测数据稀疏的极端端点的阈值,提升模型解释性和适用性。

Abstract

This article introduces a new type of linear regression model with regularization. Each predictor is conditionally truncated through the presence of unknown thresholds. The new model, called the two-way truncated linear regression model (TWT-LR), is not only viewed as a nonlinear generalization of a linear model but is also a much more flexible model with greatly enhanced interpretability and applicability. The TWT-LR model performs classifications through thresholds similar to the tree-based methods and conducts inferences that are the same as the classical linear model on different segments. In addition, the innovative penalization, called the extremely thresholding penalty (ETP), is applied to thresholds. The ETP is independent of the values of regression coefficients and does not require any normalizations of regressors. The TWT-LR-ETP model detects thresholds at a wide range, including the two extreme ends where data are sparse. Under suitable conditions, both the estimators for coefficients and thresholds are consistent, with the convergence rate for threshold estimators being faster than n. Furthermore, the estimators for coefficients are asymptotically normal for fixed dimension p. It is demonstrated in simulations and real data analyses that the TWT-LR-ETP model illustrates various threshold features and provides better estimation and prediction results than existing models. Supplementary materials for this article are available online.

线性回归正则化阈值模型统计学习机器学习