A growing body of literature has focused on understanding and addressing workplace AI design failures. However, past work has largely overlooked the role of the devaluation of worker expertise in shaping the dynamics of AI development and deployment. In this paper, we examine the case of feminized labor: a class of devalued occupations historically misnomered as ``women's work,'' such as social work, K-12 teaching, and home healthcare. Drawing on literature on AI deployments in feminized labor contexts, we conceptualize AI Failure Loops: a set of interwoven, socio-technical failure modes that help explain how the systemic devaluation of workers' expertise negatively impacts, and is impacted by, AI design, evaluation, and governance practices. These failures demonstrate how misjudgments on the automatability of workers' skills can lead to AI deployments that fail to bring value to workers and, instead, further diminish the visibility of workers' expertise. We discuss research and design implications for workplace AI, especially for devalued occupations.
翻译:现有文献日益关注理解与解决工作场所人工智能设计失败问题。然而,过往研究大多忽视了工人专业知识价值贬低在塑造AI开发与部署动态过程中的作用。本文以女性化劳动为研究对象——这类价值被贬低的职业在历史上被误称为“女性工作”,例如社会工作、K-12教育及家庭医疗护理。通过梳理女性化劳动场景中AI部署的相关文献,我们提出“AI失败循环”概念:一组相互交织的社会技术失败模式,用以解释工人专业知识的系统性贬值如何对AI设计、评估与治理实践产生负面影响,并受其反作用。这些失败案例表明,对工人技能可自动化程度的误判可能导致AI部署非但未能为工人创造价值,反而进一步削弱工人专业知识的可见性。本文最后探讨了工作场所AI(特别是针对价值贬低职业)的研究与设计启示。