Computer vision and tactile glove: A multimodal model in lifting task risk assessment
本研究结合触觉手套和计算机视觉，构建多模态模型预测举升任务风险，CNN模型准确率达89%，为实时非侵入式风险评估提供新方法。
Work-related injuries from overexertion, particularly lifting, are a major concern in occupational safety. Traditional assessment tools, such as the Revised NIOSH Lifting Equation (RNLE), require significant training and practice for deployment. This study presents an approach that integrates tactile gloves with computer vision (CV) to enhance the assessment of lifting-related injury risks, addressing the limitations of existing single-modality methods. Thirty-one participants performed 2747 lifting tasks across three lifting risk categories (LI < 1, 1 ≤ LI ≤ 2, LI > 2). Features including hand pressure measured by tactile gloves during each lift and 3D body poses estimated using CV algorithms from video recordings were combined and used to develop prediction models. The Convolutional Neural Network (CNN) model achieved an overall accuracy of 89 % in predicting the three lifting risk categories. The results highlight the potential for a real-time, non-intrusive risk assessment tool to assist ergonomic practitioners in mitigating musculoskeletal injury risks in workplace environments.