打造更大的工具箱:现有及新提出的认知能力测试粗心作答测量指标的构念效度

Building a Bigger Toolbox: The Construct Validity of Existing and Proposed Measures of Careless Responding to Cognitive Ability Tests

ORGANIZATIONAL RESEARCH METHODS · 2024
被引 3
人大 A-ABS 4

中文导读

研究了四种新指标(低频作答、指令作答、长串作答、个体内反应变异)用于检测认知能力测试中粗心作答的构念效度,发现反应时间和低频指标效度强,指令作答和个体内反应变异指标效度中等。

Abstract

Employers commonly use cognitive ability tests in the personnel selection process. Although ability tests are excellent predictors of job performance, their validity may be compromised when test takers engage in careless responding. It is thus important for researchers to have access to effective careless responding measures, which allow researchers to screen for careless responding and to evaluate efforts to prevent careless responding. Previous research has primarily used two types of measures to assess careless responding to ability tests—response time and self-reported carelessness. In the current paper, we expand the careless responding assessment toolbox by examining the construct validity of four additional measures: (1) infrequency, (2) instructed-response, (3) long-string, and (4) intra-individual response variability (IRV) indices. Expanding the available set of careless responding indices is important because the strengths of new indices may offset the weaknesses of existing indices and would allow researchers to better assess heterogeneous careless response behaviors. Across three datasets ( N = 1,193), we found strong support for the validity of the response-time and infrequency indices, and moderate support for the validity of the instructed-response and IRV indices.

心理学心理测量学人事选拔认知能力测试