基于自训练字典方法的直推式零样本学习

Transductive Zero-Shot Learning With a Self-Training Dictionary Approach

IEEE Transactions on Cybernetics · 2018
被引 86
ABS 3

中文导读

提出一种双向映射语义关系建模方案,通过将图像特征和标签嵌入投影到共同潜在空间实现跨模态知识迁移,并采用直推式学习迭代优化分类能力,在四个基准数据集上验证了有效性。

Abstract

As an important and challenging problem in computer vision, zero-shot learning (ZSL) aims at automatically recognizing the instances from unseen object classes without training data. To address this problem, ZSL is usually carried out in the following two aspects: 1) capturing the domain distribution connections between seen classes data and unseen classes data and 2) modeling the semantic interactions between the image feature space and the label embedding space. Motivated by these observations, we propose a bidirectional mapping-based semantic relationship modeling scheme that seeks for cross-modal knowledge transfer by simultaneously projecting the image features and label embeddings into a common latent space. Namely, we have a bidirectional connection relationship that takes place from the image feature space to the latent space as well as from the label embedding space to the latent space. To deal with the domain shift problem, we further present a transductive learning approach that formulates the class prediction problem in an iterative refining process, where the object classification capacity is progressively reinforced through bootstrapping-based model updating over highly reliable instances. Experimental results on four benchmark datasets (animal with attribute, Caltech-UCSD Bird2011, aPascal-aYahoo, and SUN) demonstrate the effectiveness of the proposed approach against the state-of-the-art approaches.

计算机视觉零样本学习直推式学习语义关系建模跨模态知识迁移