基于似然的稀疏协方差估计的近端距离算法

A proximal distance algorithm for likelihood-based sparse covariance estimation

Biometrika · 2022
被引 15
ABS 4

中文导读

提出一种基于似然的稀疏协方差估计方法,通过近端距离算法优化非凸目标函数,避免常见范数惩罚的收缩偏差,适用于高维小样本场景,在模拟和真实数据上优于现有方法。

Abstract

This paper addresses the task of estimating a covariance matrix under a patternless sparsity assumption. In contrast to existing approaches based on thresholding or shrinkage penalties, we propose a likelihood-based method that regularizes the distance from the covariance estimate to a symmetric sparsity set. This formulation avoids unwanted shrinkage induced by more common norm penalties, and enables optimization of the resulting nonconvex objective by solving a sequence of smooth, unconstrained subproblems. These subproblems are generated and solved via the proximal distance version of the majorization-minimization principle. The resulting algorithm executes rapidly, gracefully handles settings where the number of parameters exceeds the number of cases, yields a positive-definite solution, and enjoys desirable convergence properties. Empirically, we demonstrate that our approach outperforms competing methods across several metrics, for a suite of simulated experiments. Its merits are illustrated on international migration data and a case study on flow cytometry. Our findings suggest that the marginal and conditional dependency networks for the cell signalling data are more similar than previously concluded.

统计学协方差估计优化算法高维数据分析