一种用于基于模型的张量聚类的双重增强EM算法

A Doubly Enhanced EM Algorithm for Model-Based Tensor Clustering

Journal of the American Statistical Association · 2021
被引 35
ABS 4

中文导读

提出一种张量正态混合模型和双重增强EM算法,利用张量协方差结构减少参数并利用相关性进行变量选择和聚类,适用于高维张量数据聚类。

Abstract

Modern scientific studies often collect datasets in the form of tensors. These datasets call for innovative statistical analysis methods. In particular, there is a pressing need for tensor clustering methods to understand the heterogeneity in the data. We propose a tensor normal mixture model approach to enable probabilistic interpretation and computational tractability. Our statistical model leverages the tensor covariance structure to reduce the number of parameters for parsimonious modeling, and at the same time explicitly exploits the correlations for better variable selection and clustering. We propose a doubly enhanced expectation–maximization (DEEM) algorithm to perform clustering under this model. Both the expectation-step and the maximization-step are carefully tailored for tensor data in order to maximize statistical accuracy and minimize computational costs in high dimensions. Theoretical studies confirm that DEEM achieves consistent clustering even when the dimension of each mode of the tensors grows at an exponential rate of the sample size. Numerical studies demonstrate favorable performance of DEEM in comparison to existing methods.

聚类分析张量数据分析统计模型高维数据