EXPERT AND NAIVE RATERS USING THE PAQ: DOES IT MATTER?
指出Smith和Hakel（1979）在计算专家与新手评分者之间聚合效度时的方法问题，并通过重复研究发现聚合效度远低于原报告，提醒不能认为PAQ只测量工作的常识性知识。
A finding by Smith and Hakel (1979) is that job expert ratings on the PAQ correlate highly with ratings obtained from college students who are given no information about jobs other than their titles. One possible explanation for this finding is that the PAQ measures only trivial or common knowledge about work that both experts and naive observers possess. This particular view, of course, has serious implications for the use of the PAQ. In this paper we point out a problem in the way Smith and Hakel calculated the convergent validity between expert raters and naive raters. We also present the results from a replication study that indicate convergent validities are much lower than those reported by Smith and Hakel. Additional points are presented in order to caution against the interpretation that the PAQ measures only common knowledge about jobs.