It has been widely observed in the machine learning community that a small perturbation to the input can cause a large change in the prediction of a trained model, and such phenomena have been intensively studied in the machine learning community under the name of adversarial attacks. Because graph algorithms also are widely used for decision making and knowledge discovery, it is important to design graph algorithms that are robust against adversarial attacks. In this study, we consider the Lipschitz continuity of algorithms as a robustness measure and initiate a systematic study of the Lipschitz continuity of algorithms for (weighted) graph problems. Depending on how we embed the output solution to a metric space, we can think of several Lipschitzness notions. We mainly consider the one that is invariant under scaling of weights, and we provide Lipschitz continuous algorithms and lower bounds for the minimum spanning tree problem, the shortest path problem, and the maximum weight matching problem. In particular, our shortest path algorithm is obtained by first designing an algorithm for unweighted graphs that are robust against edge contractions and then applying it to the unweighted graph constructed from the original weighted graph. Then, we consider another Lipschitzness notion induced by a natural mapping that maps the output solution to its characteristic vector. It turns out that no Lipschitz continuous algorithm exists for this Lipschitz notion, and we instead design algorithms with bounded pointwise Lipschitz constants for the minimum spanning tree problem and the maximum weight bipartite matching problem. Our algorithm for the latter problem is based on an LP relaxation with entropy regularization.
翻译:在机器学习界广泛观察到,对输入的微小扰动可能会导致对经过训练的模型的预测发生巨大变化,而且这种现象已经在机器学习界以对抗性攻击的名义进行了深入研究。由于图表算法也广泛用于决策和知识发现,因此必须设计对对抗性攻击的强力图表算法。在本研究中,我们认为利普西茨算法的连续性是一种稳健的衡量标准,并开始系统研究利普西茨对(加权)图形问题的算法连续性。取决于我们如何将产出解决方案嵌入一个计量空间,我们可以想到若干利普西茨概念。我们主要考虑到在重量缩放中行不动的算法,我们提供利普西茨连续算法和较低界限的算法,以尽量减少树枝问题、最短路径问题和最大重量匹配问题。特别是,我们最短路径算法是通过先设计一个对边缘收缩的未加权的图表的算法,然后将它应用到从原始的正重的里程算算法的未加权点,然后我们又考虑一个不断的里基算法概念,我们用这个不断的里基算法的里基算法,然后将一个不断的里程的里程的算法去。