国际大规模评估研究中多阶段分层抽样设计与学生不参与情况下的均值成就部分识别

Partial identification of mean achievement in ILSA studies with multi-stage stratified sample designs and student non-participation

Journal of the Royal Statistical Society. Series A: Statistics in Society · 2025
被引 0
ABS 3

中文导读

研究了国际大规模评估中因学生不参与导致的识别问题,利用部分识别框架评估均值成就,并以2018年国际计算机与信息素养研究为例展示方法。

Abstract

Abstract International large-scale assessment (ILSA) studies collect information across education systems with the objective of learning about the population-wide distribution of student achievement in the assessment. In this article, we study one of the most fundamental threats that these studies face when justifying the conclusions reached about these distributions: the identification problem that arises from student non-participation during data collection. Recognizing that ILSA studies have traditionally employed a narrow range of strategies to address non-participation, we examine this problem using tools developed within the framework of partial identification of probability distributions. We tailor this framework to the problem of non-participation when data are collected using a multi-stage stratified random sample design, as in most ILSA studies. We demonstrate this approach with application to the International Computer and Information Literacy Study in 2018. We show how to use the framework to assess mean achievement under reasonable and credible sets of assumptions about the non-participating population. We also provide examples of how these results may be reported by agencies that administer ILSA studies. By doing so, we bring to the field of ILSA an alternative strategy for identification, estimation, and reporting of population parameters of interest.

教育测量抽样设计缺失数据处理国际比较研究