Recent Issues Regarding rWG, rWG, rWG(J), and rWG(J)
回应了Lindell和Brandt对James等人提出的评分者间一致性指标rWG和rWG(J)的两点质疑,证明rWG(J)可独立于Spearman-Brown公式推导,且通过重新参数化数据背后的结构方程可避免负值问题。
A recent article by Lindell and Brandt raised two concerns regarding the use of James, Demaree, and Wolf’s interrater agreement indices r WG and r WG(J) . First, they noted that the multi-item rWG(J) equation is mathematically equivalent to inserting r WG into the Spearman-Brown prophecy formula and questioned whether applying a formula developed for a reliability index was also appropriate for an agreement index. Second, they questioned the appropriateness of James et al.’s suggestion of replacing obtained negative values of r WG with zeros. This article addresses these concerns by demonstrating that r WG(J) can be derived independently from the Spearman-Brown prophecy formula and that negative values of r WG can be avoided by reparameterizing the structural equation underlying the data when there is systematic disagreement between subgroups of raters.