When algorithmic harms emerge, a reasonable response is to stop using the algorithm to resolve concerns related to fairness, accountability, transparency, and ethics (FATE). However, just because an algorithm is removed does not imply its FATE-related issues cease to exist. In this paper, we introduce the notion of the "algorithmic imprint" to illustrate how merely removing an algorithm does not necessarily undo or mitigate its consequences. We operationalize this concept and its implications through the 2020 events surrounding the algorithmic grading of the General Certificate of Education (GCE) Advanced (A) Level exams, an internationally recognized UK-based high school diploma exam administered in over 160 countries. While the algorithmic standardization was ultimately removed due to global protests, we show how the removal failed to undo the algorithmic imprint on the sociotechnical infrastructures that shape students', teachers', and parents' lives. These events provide a rare chance to analyze the state of the world both with and without algorithmic mediation. We situate our case study in Bangladesh to illustrate how algorithms made in the Global North disproportionately impact stakeholders in the Global South. Chronicling more than a year-long community engagement consisting of 47 inter-views, we present the first coherent timeline of "what" happened in Bangladesh, contextualizing "why" and "how" they happened through the lenses of the algorithmic imprint and situated algorithmic fairness. Analyzing these events, we highlight how the contours of the algorithmic imprints can be inferred at the infrastructural, social, and individual levels. We share conceptual and practical implications around how imprint-awareness can (a) broaden the boundaries of how we think about algorithmic impact, (b) inform how we design algorithms, and (c) guide us in AI governance.
翻译:当算法伤害出现时,合理的反应是停止使用算法来解决与公平、问责、透明度和道德(FATE)相关的关切。然而,仅仅因为取消算法并不意味着其与FATE有关的问题不复存在。在本文中,我们引入了“算法印记”的概念,以说明仅仅删除算法并不一定消除或减轻其后果。我们通过围绕教育通用证书高级(A)级的算法等级的2020年事件来落实这一概念及其影响。这是一个国际公认的英国在160多个国家举办的高中文凭考试。虽然算法标准化最终被删除并不意味着其与FATE相关的问题不复存在。我们展示了“算法印印记”的概念,以说明仅仅删除算法印记并不一定能消除其后果。我们通过算法调解来实施这一概念及其影响。我们把案例研究放在孟加拉国,全球北方高级(A)级的算法如何不相称地影响全球首个南方的利益攸关方。关于算法标准化标准化标准化的标准化的标准化比一年更长,我们更清楚地思考了47个内部的算算法,“我们是如何在孟加拉国内部的算法上,我们如何理解这些逻辑上的逻辑上,我们是如何理解了这些算法的。”