The concept of meaningful human control has been proposed to address responsibility gaps and mitigate them by establishing conditions that enable a proper attribution of responsibility for humans (e.g., users, designers and developers, manufacturers, legislators). However, the relevant discussions around meaningful human control have so far not resulted in clear requirements for researchers, designers, and engineers. As a result, there is no consensus on how to assess whether a designed AI system is under meaningful human control, making the practical development of AI-based systems that remain under meaningful human control challenging. In this paper, we address the gap between philosophical theory and engineering practice by identifying four actionable properties which AI-based systems must have to be under meaningful human control. First, a system in which humans and AI algorithms interact should have an explicitly defined domain of morally loaded situations within which the system ought to operate. Second, humans and AI agents within the system should have appropriate and mutually compatible representations. Third, responsibility attributed to a human should be commensurate with that human's ability and authority to control the system. Fourth, there should be explicit links between the actions of the AI agents and actions of humans who are aware of their moral responsibility. We argue these four properties are necessary for AI systems under meaningful human control, and provide possible directions to incorporate them into practice. We illustrate these properties with two use cases, automated vehicle and AI-based hiring. We believe these four properties will support practically-minded professionals to take concrete steps toward designing and engineering for AI systems that facilitate meaningful human control and responsibility.
翻译:提出了有意义的人类控制概念,以解决责任差距问题,并通过建立能够适当划分对人类责任的条件(如用户、设计者和开发者、制造商、立法者)来缩小责任差距。然而,关于有意义的人类控制的相关讨论迄今尚未导致对研究人员、设计者和工程师提出明确的要求。因此,对于如何评估设计中的AI系统是否处于有意义的人类控制之下,如何使基于AI的系统的实际发展仍然处于有意义的人类控制之下,从而使以AI为基础的系统具有挑战性的挑战性。在本文件中,我们通过确定基于AI的系统必须置于有意义的人类控制之下的四种可操作的属性来解决哲学理论与工程实践之间的差距。首先,人类和AI算法相互作用的系统应当有一个明确界定的关于系统应操作道德上装满情况的领域。第二,系统内的人类和AI代理应当有适当和相互兼容的表述。第三,由人类承担的责任应当与基于人类控制该系统的能力和权威相称。第四,AI系统应当明确将AI代理人员和了解其道德上责任的人类专业人员的行动联系起来。我们说,这四种情况下,我们用这些操作系统可以说明它们具有道德上的责任。