Explanations are well-known to improve recommender systems' transparency. These explanations may be local, explaining an individual recommendation, or global, explaining the recommender model in general. Despite their widespread use, there has been little investigation into the relative benefits of these two approaches. Do they provide the same benefits to users, or do they serve different purposes? We conducted a 30-participant exploratory study and a 30-participant controlled user study with a research-paper recommender system to analyze how providing participants local, global, or both explanations influences user understanding of system behavior. Our results provide evidence suggesting that both explanations are more helpful than either alone for explaining how to improve recommendations, yet both appeared less helpful than global alone for efficiency in identifying false positives and negatives. However, we note that the two explanation approaches may be better compared in the context of a higher-stakes or more opaque domain.
翻译:众所周知,这些解释是为了提高建议者系统的透明度。这些解释可能是局部性的,解释个别建议,或全球性的,解释建议者模式。尽管这些解释被广泛使用,但对这两种方法的相对好处却很少进行调查。它们是否为用户提供同样的好处,或者它们服务于不同的目的?我们进行了30个参与者的探索性研究和30个参与者控制的用户研究,并使用研究文件建议系统来分析提供参与者、全球或两种解释如何影响用户对系统行为的理解。我们的结果提供了证据,表明两种解释都比单独解释如何改进建议更有帮助,但似乎都不如单是全球性的帮助,在查明错误的正反两方面的效率方面。然而,我们注意到,两种解释方法可能比较高的取量或更不透明的领域要好。