Applying Item Response Theory to Multisource Performance Ratings: What are the Consequences of Violating the Independent Observations Assumption?
研究了多源绩效评价中违反独立观测假设对项目反应理论分析的影响,发现该违反不会显著改变项目参数,表明无需丢弃数据即可应用项目反应理论。
Multisource performance ratings involve multiple raters of a common target, thus violating the statistical assumption of independent observations. This study investigated the consequences of that violation on item response theory–based analyses of ratings in two domains of managerial performance. Using a differential item functioning framework, the authors found no significant differences in item parameters attributable to the violation. This finding suggests that item response theory can be applied to multisource ratings without discarding data in order to meet the independence assumption.