以手势为中心的交互:评估非接触式光标控制中的手部和头部手势

Gesture centric interaction: evaluating hand and head gestures in touchless cursor control

Ergonomics · 2024
被引 4
ABS 3

中文导读

利用MediaPipe框架设计了基于手部和头部手势的两种非接触式光标控制系统,通过Fitts定律实验比较性能,发现手部手势控制优于头部手势控制。

Abstract

Touchless interfaces have gained considerable importance in the modern era, particularly due to their user-friendly and hygienic nature of interaction. This article presents the designing of two touchless cursor control systems based on hand gestures and head movements utilising the MediaPipe framework to extract the key landmarks of the hand and face utilising a laptop camera. The index finger's landmark points are tracked and converted to corresponding screen coordinates for cursor control. Similarly, yaw and pitch angles of head movements are computed in the head movement-based cursor design. A comprehensive performance evaluation of the two proposed systems based on a two-dimensional (2D) Fitts' law experiment revealed superior performance for the hand gesture-controlled cursor compared to the head movement-controlled cursor with throughputs of 0.59 bps and 0.53 bps respectively. Participants also favoured hand gesture-based cursor control over head movement-based cursor control in terms of overall experience and task difficulty.

人机交互手势识别计算机视觉光标控制