基于多任务拉普拉斯稀疏表示的灰度-热红外目标跟踪

Grayscale-Thermal Object Tracking via Multitask Laplacian Sparse Representation

IEEE Transactions on Systems, Man, and Cybernetics: Systems · 2017
被引 77
ABS 3

中文导读

提出一种在贝叶斯滤波框架下结合灰度与热红外模态的多任务拉普拉斯稀疏表示方法,通过局部块联合稀疏表示和模态可靠性自适应融合,提升复杂场景下的目标跟踪性能。

Abstract

This paper studies the problem of object tracking in challenging scenarios by leveraging multimodal visual data. We propose a grayscale-thermal object tracking method in Bayesian filtering framework based on multitask Laplacian sparse representation. Given one bounding box, we extract a set of overlapping local patches within it, and pursue the multitask joint sparse representation for grayscale and thermal modalities. Then, the representation coefficients of the two modalities are concatenated into a vector to represent the feature of the bounding box. Moreover, the similarity between each patch pair is deployed to refine their representation coefficients in the sparse representation, which can be formulated as the Laplacian sparse representation. We also incorporate the modal reliability into the Laplacian sparse representation to achieve an adaptive fusion of different source data. Experiments on two grayscale-thermal datasets suggest that the proposed approach outperforms both grayscale and grayscale-thermal tracking approaches.

目标跟踪多模态数据融合稀疏表示计算机视觉