Investigating mental workload across task modalities: a multimodal analysis using pupillometry
通过实验研究不同信息模态下任务负荷对绩效、感知负荷和瞳孔指标的影响，发现峰值瞳孔潜伏期、准确率和NASA-TLX在言语和视觉模态中表现稳健，而峰值瞳孔直径受模态影响较弱。
Understanding mental workload is challenging due to its multidimensional nature and varying sensitivities of its primary measures: task performance, perceived workload, and physiological responses. This study investigates the effects of task load on performance, perceived workload, and pupil measures across different information modalities. A within-subjects experiment involving three tasks (digit span, matrix span, and dual n-back) was conducted with three task load levels. Workload measures included accuracy/sensitivity, reaction time, NASA-TLX, peak pupil diameter, and peak pupil latency. Consistent patterns of associations between task load and these workload measures were found across the three modalities. Workload measures revealed a nuanced interplay between task modality and task load. Robustness of peak pupil latency, accuracy, and NASA-TLX was highlighted across verbal and visual modalities, while peak pupil diameter showed a weaker impact with differences between modalities. The findings encourage multivariate assessment of mental workload to account for different task modalities.