Leveraging AI to Capture Textual and Visual Elements: Insights for HRM Research and Practice
本文提出一种利用大语言模型GPT-4o-mini分析社交媒体中文本和图像的方法，帮助人力资源管理研究者从多模态数据中获取微观、中观和宏观层面的洞察，并讨论了在招聘、员工敬业度评估和组织形象等方面的实践应用。
ABSTRACT This paper advances Human Resource Management (HRM) scholarship by introducing an accessible method to analyse of both visual and textual social media content in combination. Although HRM studies increasingly mobilise social media data, most approaches remain text‐centric, overlooking the HR‐relevant cues, embedded in images, that can inform micro, meso and macro level interpretations. We propose a method that classifies latent features from images and texts by leveraging the potential of a Large Language Model, namely GPT‐4o‐mini. We illustrate the method with an example that reports a promising performance of the GPT‐4o‐mini model. We highlight the conceptual potential of our method for theory development through multimodal data, enabling multi‐level analysis of HRM phenomena, and we discuss practical applications for HR practitioners in recruitment and selection, gauging employee engagement, and assessing organisational image, alongside limitations and considerations for responsible use.