Local governments increasingly use artificial intelligence (AI) for automated decision-making. Contestability, making systems responsive to dispute, is a way to ensure they respect human rights to autonomy and dignity. We investigate the design of public urban AI systems for contestability through the example of camera cars: human-driven vehicles equipped with image sensors. Applying a provisional framework for contestable AI, we use speculative design to create a concept video of a contestable camera car. Using this concept video, we then conduct semi-structured interviews with 17 civil servants who work with AI employed by a large northwestern European city. The resulting data is analyzed using reflexive thematic analysis to identify the main challenges facing the implementation of contestability in public AI. We describe how civic participation faces issues of representation, public AI systems should integrate with existing democratic practices, and cities must expand capacities for responsible AI development and operation.
翻译:地方政府越来越多地使用人工智能(AI)进行自动决策。竞争,使系统对争议作出反应,是确保尊重自主和尊严的人权的一种方式。我们通过照相车的例子调查设计公共城市人工智能系统以进行竞争:配备图像传感器的人类驱动车辆。我们应用可竞争的人工智能临时框架,我们利用投机设计来制作可竞争的照相车的概念视频。我们利用这个概念视频,与17名公务员进行半结构式访谈,他们与一家大型欧洲西北部城市雇用的人工智能合作工作。通过反射专题分析对由此产生的数据进行了分析,以确定在公共人工智能中执行可竞争性所面临的主要挑战。我们描述了公民参与如何面临代表性问题,公共人工智能系统应当与现有的民主做法相结合,城市必须扩大负责任的开发和运作人工智能的能力。