高维稀疏二次判别分析的一种凸优化方法

A convex optimization approach to high-dimensional sparse quadratic discriminant analysis

Annals of Statistics · 2021
被引 15
ABS 4★

中文导读

研究了高维稀疏二次判别分析的最优分类误差收敛速率,提出基于约束凸优化的SDAR算法,在模拟和真实癌症数据中表现良好。

Abstract

In this paper, we study high-dimensional sparse Quadratic Discriminant Analysis (QDA) and aim to establish the optimal convergence rates for the classification error. Minimax lower bounds are established to demonstrate the necessity of structural assumptions such as sparsity conditions on the discriminating direction and differential graph for the possible construction of consistent high-dimensional QDA rules. We then propose a classification algorithm called SDAR using constrained convex optimization under the sparsity assumptions. Both minimax upper and lower bounds are obtained and this classification rule is shown to be simultaneously rate optimal over a collection of parameter spaces, up to a logarithmic factor. Simulation studies demonstrate that SDAR performs well numerically. The algorithm is also illustrated through an analysis of prostate cancer data and colon tissue data. The methodology and theory developed for high-dimensional QDA for two groups in the Gaussian setting are also extended to multigroup classification and to classification under the Gaussian copula model.

高维统计分类算法凸优化判别分析