Are algorithms biased in education? Exploring racial bias in predicting community college student success
研究了两种预测模型（课程完成和学位完成）中的算法偏见，发现若用模型识别“高风险”学生，边缘黑人学生更少获得额外支持，且偏见程度因风险定义不同而变化。
Abstract Predictive analytics are increasingly pervasive in higher education. However, algorithmic bias has the potential to reinforce racial inequities in postsecondary success. We provide a comprehensive and translational investigation of algorithmic bias in two separate prediction models—one predicting course completion, the second predicting degree completion. We show that if either model were used to target additional supports for “at‐risk” students, then the algorithmic bias would lead to fewer marginal Black students receiving these resources. We also find the magnitude of algorithmic bias varies within the distribution of predicted success. With the degree completion model, the amount of bias is over 5 times higher when we define at‐risk using the bottom decile than when we focus on students in the bottom half of predicted scores; in the course completion model, the reverse is true. These divergent patterns emphasize the contextual nature of algorithmic bias and attempts to mitigate it. Our results moreover suggest that algorithmic bias is due in part to currently‐available administrative data being relatively less useful at predicting Black student success, particularly for new students; this suggests that additional data collection efforts have the potential to mitigate bias.