The graph neural network (GNN) models have presented impressive achievements in numerous machine learning tasks. However, many existing GNN models are shown to be vulnerable to adversarial attacks, which creates a stringent need to build robust GNN architectures. In this work, we propose a novel interpretable message passing scheme with adaptive structure (ASMP) to defend against adversarial attacks on graph structure. Layers in ASMP are derived based on optimization steps that minimize an objective function that learns the node feature and the graph structure simultaneously. ASMP is adaptive in the sense that the message passing process in different layers is able to be carried out over dynamically adjusted graphs. Such property allows more fine-grained handling of the noisy (or perturbed) graph structure and hence improves the robustness. Convergence properties of the ASMP scheme are theoretically established. Integrating ASMP with neural networks can lead to a new family of GNN models with adaptive structure (ASGNN). Extensive experiments on semi-supervised node classification tasks demonstrate that the proposed ASGNN outperforms the state-of-the-art GNN architectures in terms of classification performance under various adversarial attacks.
翻译:图形神经网络模型(GNN)在许多机器学习任务中取得了令人印象深刻的成就,然而,许多现有的GNN模型被证明很容易受到对抗性攻击,从而产生了建立强大的GNN结构的严格需要。在这项工作中,我们提议了一个具有适应性结构(ASMP)的可解释信息传递新办法,以防御图形结构的对抗性攻击。ASMP中的图层是根据优化步骤产生的,这些步骤最大限度地减少了一个同时了解节点特征和图形结构的客观功能。ASMP是适应性的,因为不同层次的信息传递过程能够通过动态调整的图表进行。这些属性使得能够更精细地处理噪音(或四周)的图形结构,从而改进坚固性。ASMP计划的趋同性性质在理论上已经确立。将ASMP与神经网络结合,可以导致将GNNN模型与适应性结构(ASGNN)的新的组合。关于半超型节点分类任务的广泛实验表明,拟议的ASGNNNN在各种对抗性攻击的表现方面超越了状态的GNNNN结构。