This paper analyses the fundamental ingredients behind surrogate explanations to provide a better understanding of their inner workings. We start our exposition by considering global surrogates, describing the trade-off between complexity of the surrogate and fidelity to the black-box being modelled. We show that transitioning from global to local - reducing coverage - allows for more favourable conditions on the Pareto frontier of fidelity-complexity of a surrogate. We discuss the interplay between complexity, fidelity and coverage, and consider how different user needs can lead to problem formulations where these are either constraints or penalties. We also present experiments that demonstrate how the local surrogate interpretability procedure can be made interactive and lead to better explanations.
翻译:本文分析了代用解释背后的基本要素,以便更好地了解其内在作用。 我们首先从考虑全球代用人开始阐述,描述代用人的复杂性和对模拟黑匣子的忠诚之间的权衡。我们表明,从全球向地方的过渡(缩小覆盖面)使得替代人忠诚和兼容性的Pareto边界条件更加有利。我们讨论了复杂性、忠诚性和覆盖面之间的相互作用,并审议了不同用户的需要如何导致问题配方,而这些问题要么是制约因素,要么是惩罚因素。我们还介绍了如何使当地代用人的解释程序具有互动性并导致更好的解释的实验。