Predicting Instructor Performance in Online Education: An Interpretable Hierarchical Transformer with Contextual Attention
提出一种可解释的层次化Transformer模型，利用文本数据预测在线教育平台上的教师评分和课程评分，并通过可解释性分析揭示预测背后的原因，对教师和平台改进课程有管理启示。
Online education is a vital consumer industry that is undergoing rapid technological change. This paper develops a deep learning model to predict instructor performance on online education platforms from a content-based perspective. Specifically, we design an interpretable hierarchical transformer with contextual attention to predict instructor rating and course rating using textual data. Our model captures the inherent hierarchical structure of online courses and the sequential dependency of lectures within a course. Moreover, it goes beyond prediction and enables interpretability analysis, which provides additional insights into potential reasons behind the predictions made by the model. Extensive experiments demonstrate that our model outperforms classic machine learning models as well as state-of-the-art deep learning models. Furthermore, we conduct in-depth interpretability analysis to explore what factors might predict the success of an online course at the lecture, sentence, and word level. We also showcase the value and applicability of our model through a randomized experiment. Our findings and methods provide managerial implications for instructors and online education platforms to improve course creation and delivery in this vitally important emerging market.