算法污染:让不可见变得可见

Algorithmic Pollution: Making the Invisible Visible

Journal of Information Technology · 2021
被引 5
ABS 4

中文导读

本文提出‘算法污染’概念,指自动化算法决策在福利、医疗、教育等公共服务中产生的无意社会危害,并呼吁采取变革行动来预防、检测和纠正这些危害。

Abstract

In this paper, we focus on the growing evidence of unintended harmful societal effects of automated algorithmic decision-making (AADM) in transformative services (e.g., social welfare, healthcare, education, policing and criminal justice), for individuals, communities and society at large. Drawing from the long-established research on social pollution, in particular its contemporary ‘pollution-as-harm’ notion, we put forward a claim, and provide evidence, that these harmful effects constitute a new type of digital social pollution, which we name ‘algorithmic pollution’. Words do matter, and by using the term ‘pollution’, not as a metaphor, but as a transformative redefinition of the digital harm performed by AADM, we seek to make it visible and recognized. By adopting a critical performative perspective, we explain how the execution of AADM produces harm and thus performs algorithmic pollution. Recognition of the potential for unintended harmful effects of algorithmic pollution, and their examination as such, leads us to articulate the need for transformative actions to prevent, detect, redress, mitigate, and educate about algorithmic harm. These actions, in turn, open up new research challenges for the information systems community.

信息系统算法公平社会污染数字伦理