Strong oracle guarantees for partial penalized tests of high-dimensional generalized linear models
针对高维广义线性模型中的线性假设检验,提出局部线性近似算法,证明其两步收敛到oracle估计量,并保证检验统计量渐近卡方分布,填补了理论与计算之间的空白。
Abstract Partial penalized tests provide flexible approaches to testing linear hypotheses in high-dimensional generalized linear models. However, because the estimators used in these tests are local minimizers of potentially nonconvex folded-concave penalized objectives, the solutions one computes in practice may not coincide with the unknown local minima for which we have nice theoretical guarantees. To close this gap between theory and computation, we introduce local linear approximation (LLA) algorithms to compute the full and reduced model estimators for these tests and develop a theory specifically for the LLA solutions. We prove that our LLA algorithms converge to oracle estimators for the full and reduced models in two steps with overwhelming probability. We then leverage this strong oracle result and the asymptotic properties of the oracle estimators to show that the partial penalized test statistics evaluated at the LLA solutions are approximately chi-square in large samples, giving us guarantees for the tests using specific computed solutions and thereby closing the theoretical gap. In simulations, we find that our LLA tests closely agree with the oracle tests and compare favourably with alternative high-dimensional inference procedures. We demonstrate the flexibility of our LLA tests with two high-dimensional data applications.