Practical uses of Artificial Intelligence (AI) in the real world have demonstrated the importance of embedding moral choices into intelligent agents. They have also highlighted that defining top-down ethical constraints on AI according to any one type of morality is extremely challenging and can pose risks. A bottom-up learning approach may be more appropriate for studying and developing ethical behavior in AI agents. In particular, we believe that an interesting and insightful starting point is the analysis of emergent behavior of Reinforcement Learning (RL) agents that act according to a predefined set of moral rewards in social dilemmas. In this work, we present a systematic analysis of the choices made by intrinsically-motivated RL agents whose rewards are based on moral theories. We aim to design reward structures that are simplified yet representative of a set of key ethical systems. Therefore, we first define moral reward functions that distinguish between consequence- and norm-based agents, between morality based on societal norms or internal virtues, and between single- and mixed-virtue (e.g., multi-objective) methodologies. Then, we evaluate our approach by modeling repeated dyadic interactions between learning moral agents in three iterated social dilemma games (Prisoner's Dilemma, Volunteer's Dilemma and Stag Hunt). We analyze the impact of different types of morality on the emergence of cooperation, defection or exploitation, and the corresponding social outcomes. Finally, we discuss the implications of these findings for the development of moral agents in artificial and mixed human-AI societies.
翻译:在现实世界中,人工智能(AI)的实际用途已经表明将道德选择纳入智能剂的重要性。他们还强调指出,根据任何一种道德界定自上而下对AI的道德约束是极具挑战性的,而且可能构成风险。自下而上学习的方法可能更适合于在人工智能剂中研究和开发道德行为。特别是,我们认为,一个令人感兴趣和深刻的起点是分析根据社会困境中一套预先界定的道德奖励办法采取行动的加强学习(RL)的新兴行为。在这项工作中,我们系统地分析以道德理论为依据的、具有内在动机的RL代理人所作的选择。我们的目标是设计简化但代表一套关键道德制度的奖励结构。因此,我们首先界定道德奖励功能,区分基于社会规范或内部美德的代理人,以及单一和混合的道德(例如,多客观)方法。然后,我们通过在三个反复学习道德代理人的道德因素之间进行模拟互动,这些道德因素在三盘深层次的人类两极分化的人类两极分化的两极分化的两极分化的两极化的两极分化的两极分化的两极分化的两极分化的两极分化的两极分化的两极分化的两极分化的两极分化的两极分化的两极分化的两极分的两极分化的两极分化的两极分分分分的两极分的两极分的两极分的两极分的两极分的两极分的两极分的两极分的两极分的两极分制的两极分制的两极分制的两极分制的两极分制的两极分制的两的两的两的两的两极分制的两极分制,即分制的两的两极分制的两极分制的两极制的两极制的两极制的两极制的两极分制的两相。。。。