🌙

基于多模态特征和深度迁移学习的万向节轴承多表面缺陷检测

Multi-surface defect detection for universal joint bearings via multimodal feature and deep transfer learning

International Journal of Production Research · 2022
被引 17
ABS 3

中文导读

提出一种多表面缺陷检测方法,通过自适应区域分割、多模态融合形状描述子和迁移学习,解决万向节轴承多表面背景纹理和缺陷特征多样导致的检测难题,在实验中达到94.8%的宏F1分数。

Abstract

Surface defect detection by machine vision has received increased attention concerning the quality control of universal joint bearings (UJB). The defect distribution and counting information are important for product quality optimisation. However, vision defect detection for UJB remains a challenging task due to the diversity of background textures and defect characters on multiple surfaces. In this study, a multi-surface defect detection (MSDD) method consisting of region segmentation, feature extraction and detection is proposed. First, defect regions are accurately localised by the proposed adaptive defect region segmentation algorithm, which suppresses the inference of background variety. Then, a novel defect feature named multimodal fusion shape descriptor that integrates the global information and local information of defects is constructed to generate the discriminative defect representation. Finally, a defect feature extraction ability transfer strategy based on the transfer learning mechanism is proposed to address the problem of insufficient defect samples. The experimental results show that our method achieves the best accuracy of 94.8% macro-F1 and processes 28 defect images per second. Besides, the application effect in the practical production line indicates that our method meets the accuracy and real-time requirements of MSDD for UJB.

计算机视觉缺陷检测迁移学习工业质检特征提取