一种线性计算代价的多视图学习框架

A Multiview Learning Framework With a Linear Computational Cost

IEEE Transactions on Cybernetics · 2017
被引 19
ABS 3

中文导读

提出一种线性计算代价的多视图学习框架,能同时分析所有特征并自动选择重要视图,适用于大规模多类多标签分类问题。

Abstract

Learning features from multiple views has attracted much research attention in different machine learning tasks, such as multiclass and multilabel classification problems. In this paper, we propose a multiclass multilabel multiview learning framework with a linear computational cost where an example is associated with at least one label and represented by multiple information sources. We simultaneously analyze all features by learning an integrated projection matrix. We can also automatically select more important views for subsequent classifier to predict each class. As the proposed objective function is nonsmooth and difficult to solve, we apply a novel optimization method that converts the multiview learning problem to a set of linear single-view learning problems by bridging our problem to an easily solvable approach. Compared to the conventional methods which learn the entire projection matrix, our algorithm independently optimizes each column of the projection matrix for each class, which can be easily parallelized. In each column optimization, the most computationally intensive step is pure and simple matrix-by-vector multiplication. As a result, our algorithm is much more applicable to large-scale problems than the multiview learning methods with a nonlinear computational cost. Moreover, rigorous convergence proof of the proposed algorithm is also provided. To evaluate the effectiveness of the proposed approach, experimental comparisons are made with state-of-the-art algorithms in multiclass and multilabel classification tasks on many multiview benchmarks. We also report the efficiency comparison results on different numbers of data samples. The experimental results demonstrate that our algorithm can achieve superior performance to all the compared algorithms.

多视图学习多类分类多标签分类机器学习