Recently, requirements for the explainability of software systems have gained prominence. One of the primary motivators for such requirements is that explainability is expected to facilitate stakeholders' trust in a system. Although this seems intuitively appealing, recent psychological studies indicate that explanations do not necessarily facilitate trust. Thus, explainability requirements might not be suitable for promoting trust. One way to accommodate this finding is, we suggest, to focus on trustworthiness instead of trust. While these two may come apart, we ideally want both: a trustworthy system and the stakeholder's trust. In this paper, we argue that even though trustworthiness does not automatically lead to trust, there are several reasons to engineer primarily for trustworthiness -- and that a system's explainability can crucially contribute to its trustworthiness.
翻译:最近,软件系统解释性的要求越来越突出。这种要求的主要动力之一是,解释性预期会促进利益攸关方对系统的信任。虽然这似乎直观地具有吸引力,但最近的心理研究表明解释性不一定促进信任。因此,解释性要求可能不适合促进信任。我们建议,一个兼顾这一结论的方法是注重可信度而不是信任性。虽然这两个结论可能出现分歧,但我们希望两者同时存在:一个可信赖的系统和利益攸关方的信任。在本文中,我们争论说,即使信任性不会自动导致信任,但主要出于可信度的缘故进行工程设计,而且系统的可解释性可以极大地促进其信任性。