9 Validity, Validation and Values
探讨了组织中使用测试的效度问题,指出效度取决于测试的具体用途,并比较了不同验证策略的优缺点,提出多变量模型能更好地整合不同标准。
Tests and assessments are used in organizations for a wide range of purposes, and it is the uses of tests, not the tests themselves, that are validated. As a result, the critical question is often not “Is this test valid?”, but rather “Valid for what?”. Tests normally have multiple uses and purposes in organizations, which may be defined and understood differently by different stakeholders, and tests might have as many validities as they have uses. The strengths and weaknesses of existing validation strategies are examined and compared in the light of the ways tests are used in organizations. Content validation often seems unconnected with the ways tests are used and interpreted in organizations, and is not always useful a strategy for validating tests. Criterion‐oriented validation methods (including sophisiticated variants, such as the validity generalization model) are often deficient because they apply a univariate strategy for evaluating what is clearly a multivariate phenomenon—i.e., use of test scores to make high‐stakes decisions in organization. Multivariate models of validation provide an opportunity to integrate qualitatively different criteria (e.g., efficiency and equity) in evaluating the validity of a test as it is used in an organization.