The deployment of Socially Intelligent Agents (SIAs) in learning environments has proven to have several advantages in different areas of application. Social Agent Authoring Tools allow scenario designers to create tailored experiences with high control over SIAs behaviour, however, on the flip side, this comes at a cost as the complexity of the scenarios and its authoring can become overbearing. In this paper we introduce the concept of Explainable Social Agent Authoring Tools with the goal of analysing if authoring tools for social agents are understandable and interpretable. To this end we examine whether an authoring tool, FAtiMA-Toolkit, is understandable and its authoring steps interpretable, from the point-of-view of the author. We conducted two user studies to quantitatively assess the Interpretability, Comprehensibility and Transparency of FAtiMA-Toolkit from the perspective of a scenario designer. One of the key findings is the fact that FAtiMA-Toolkit's conceptual model is, in general, understandable, however the emotional-based concepts were not as easily understood and used by the authors. Although there are some positive aspects regarding the explainability of FAtiMA-Toolkit, there is still progress to be made to achieve a fully explainable social agent authoring tool. We provide a set of key concepts and possible solutions that can guide developers to build such tools.
翻译:实践证明,在学习环境中部署社会智能代理(SIAs)在不同应用领域具有若干优势。社会代理作者工具允许情景设计师根据对SIA行为的高度控制来创造量身定制的经验,但是,从反面看,由于情景的复杂性及其作者可能过于复杂,这代价很大。在本文中,我们引入了可解释的社会代理作者工具的概念,目的是分析社会代理作者的作者工具是否可理解和可解释。为此,我们从作者的观点来看,我们研究一个作者的创作工具FAtiMA-Toolkit是否可以理解,并编写步骤可以解释。我们进行了两个用户研究,从情景设计师的角度对FATIMA-Toolkit的可解释性、易懂性和透明性进行定量评估。一个关键发现是,FATIMA-Toolkit的概念模型一般是可以理解的,然而,基于情感的概念并非易懂易懂的,而且作者也使用。虽然从作者的角度评估了FATIMA-Torkit的易懂性概念,但我们还是可以充分解释出一个关键的工具,我们可以用来解释出一个可以建立发展工具。