A digital twin-driven human-machine interactive assembly method based on lightweight multi-target detection and assembly feature generation
提出一种数字孪生驱动的人机交互装配方法，用轻量级YOLOv7-tiny模型检测零件，通过注意力模块增强特征提取，以减速器装配为例验证，能提供视觉引导、提高装配效率，适合指导新手操作。
In the field of industrial assembly, human-machine interactive assembly methods are frequently used. Lack of virtual and physical mapping, a convoluted guiding system, and low effect precision in the interactive process, a digital twin-driven human-machine interactive assembly method system is proposed as a solution to the mentioned issues. The YOLOv7-tiny lightweight model is used to perform accurate detection of parts. By incorporating attention modules into the backbone network, the feature extraction capability of the model in complicated assembly environments is enhanced. The assembly method proposed is validated using the assembly process of the reducer as an instance. The OpenCV method is employed to produce geometric reference features for parts. The experimental results show that the proposed assembly method can provide visual guidance for the assembly process, improve the traditional list-type assembly component retrieval method, solve the drawbacks of the pre-set assembly guidance in the guidance system that may not be able to adapt to the changes of the assembly results in the actual operation, and can accurately instruct novices how to assemble, which is characterised by easy implementation, low cost and high accuracy, and is of great significance for improving the success rate and assembly efficiency of human-machine interactive assembly.