Recent years have seen growing adoption of AI-based decision-support systems (ADS) in homeless services, yet we know little about stakeholder desires and concerns surrounding their use. In this work, we aim to understand impacted stakeholders' perspectives on a deployed ADS that prioritizes scarce housing resources. We employed AI lifecycle comicboarding, an adapted version of the comicboarding method, to elicit stakeholder feedback and design ideas across various components of an AI system's design. We elicited feedback from county workers who operate the ADS daily, service providers whose work is directly impacted by the ADS, and unhoused individuals in the region. Our participants shared concerns and design suggestions around the AI system's overall objective, specific model design choices, dataset selection, and use in deployment. Our findings demonstrate that stakeholders, even without AI knowledge, can provide specific and critical feedback on an AI system's design and deployment, if empowered to do so.
翻译：近年来，无家可归者服务领域越来越多地采用基于人工智能的决策支持系统（ADS），但我们知之甚少有关相关利益相关者使用ADS的愿望和关切。在这项工作中，我们旨在了解受影响的利益相关者对部署的ADS的观点，该系统优先考虑稀缺房屋资源。我们采用了AI生命周期漫画板，这是一个漫画板方法的改进版本，以收集关于AI系统设计的各种组成部分的反馈和设计思想。我们收集了日常操作ADS的县级工作者、直接受到ADS影响的服务提供商和该地区的无家可归者的反馈意见。参与者对AI系统的总体目标、具体的模型设计选择、数据集选择和在部署中的使用提出了关注和设计建议。我们的研究结果表明，即使没有AI知识，利益相关者也可以在设计和部署AI系统方面提供具体和关键的反馈，如果获得相应的支持。
相关内容
微信扫码咨询专知VIP会员