Explainable Artificial Intelligence (XAI) has in recent years become a well-suited framework to generate human understandable explanations of black box models. In this paper, we present a novel XAI visual explanation algorithm denoted SIDU that can effectively localize entire object regions responsible for prediction in a full extend. We analyze its robustness and effectiveness through various computational and human subject experiments. In particular, we assess the SIDU algorithm using three different types of evaluations (Application, Human and Functionally-Grounded) to demonstrate its superior performance. The robustness of SIDU is further studied in presence of adversarial attack on black box models to better understand its performance.
翻译:近年来,可解释的人工智能(XAI)已经成为一个非常合适的框架,可以使人们理解黑盒模型的解释。在本文中,我们提出了一个新颖的XAI直观解释算法,它代表SIDU, 能够将负责预测的整个目标区域完全本地化。我们通过各种计算和人类主题实验分析其稳健性和有效性。特别是,我们利用三种不同的评价(应用、人和功能四舍五入)来评估SIDU算法,以证明其优异的性能。在对黑盒模型进行对抗性攻击的情况下,SIDU的强健性得到了进一步研究,以更好地了解其性能。