Supervised Predictive Modeling of High-Dimensional Data with Group l 0 -Norm Constrained Neural Networks
提出一种群组l0范数约束神经网络的稀疏优化方法，能同时提取关键特征并估计模型函数，在变量选择和预测上优于传统Lasso方法。
To flexibly handle high-dimensional data, this paper develops a new sparsity-constrained optimization approach. By leveraging group l0-norm constrained neural networks, the proposed approach aims to simultaneously extract crucial features and estimate the underlying model function with statistically guaranteed accuracy. Under some mild conditions, we establish statistical theories of the proposed method for a general class of nonparametric regression-type loss functions. Moreover, two iterative greedy selection algorithms, which iterate between a standard gradient descent step and a hard thresholding step with or without debiasing, are presented to implement the computation. Convergence guarantees and sparsity recovery capabilities of these algorithms are rigorously examined. Empirical validation through a series of comprehensive experiments conducted on both real-world and synthetic datasets underscores the superior performance of our proposed estimator. In various scenarios, the proposed approach surpasses conventional Lasso-based sparse learning methods in terms of variable selection accuracy and prediction performance, thereby highlighting its efficacy in practical applications.