利用视觉邻近一致性优化的视频去色

Video Decolorization Using Visual Proximity Coherence Optimization

IEEE Transactions on Cybernetics · 2017
被引 17
ABS 3

中文导读

提出一种视频去色框架,通过定义帧间邻近度并分类处理,在保持时间一致性的同时提升效率,适用于需要快速将彩色视频转为灰度且保留视觉内容的场景。

Abstract

Video decolorization is to filter out the color information while preserving the perceivable content in the video as much and correct as possible. Existing methods mainly apply image decolorization strategies on videos, which may be slow and produce incoherent results. In this paper, we propose a video decolorization framework that considers frame coherence and saves decolorization time by referring to the decolorized frames. It has three main contributions. First, we define decolorization proximity to measure the similarity of adjacent frames. Second, we propose three decolorization strategies for frames with low, medium, and high proximities, to preserve the quality of these three types of frames. Third, we propose a novel decolorization Gaussian mixture model to classify the frames and assign appropriate decolorization strategies to them based on their decolorization proximity. To evaluate our results, we measure them from three aspects: 1) qualitative; 2) quantitative; and 3) user study. We apply color contrast preserving ratio and C2G-SSIM to evaluate the quality of single frame decolorization. We propose a novel temporal coherence degree metric to evaluate the temporal coherence of the decolorized video. Compared with current methods, the proposed approach shows all around better performance in time efficiency, temporal coherence, and quality preservation.

计算机视觉视频处理图像去色时间一致性