Neural diffusion on graphs is a novel class of graph neural networks that has attracted increasing attention recently. The capability of graph neural partial differential equations (PDEs) in addressing common hurdles of graph neural networks (GNNs), such as the problems of over-smoothing and bottlenecks, has been investigated but not their robustness to adversarial attacks. In this work, we explore the robustness properties of graph neural PDEs. We empirically demonstrate that graph neural PDEs are intrinsically more robust against topology perturbation as compared to other GNNs. We provide insights into this phenomenon by exploiting the stability of the heat semigroup under graph topology perturbations. We discuss various graph diffusion operators and relate them to existing graph neural PDEs. Furthermore, we propose a general graph neural PDE framework based on which a new class of robust GNNs can be defined. We verify that the new model achieves comparable state-of-the-art performance on several benchmark datasets.
翻译:图表上的神经扩散是一个新型的图形神经网络类别,最近引起了越来越多的关注。图形神经部分方程式(PDEs)在解决图形神经网络常见障碍(GNNS)方面的能力,例如过度吸附和瓶颈问题,已经调查过,但对于对抗性攻击而言,它们没有很强性能。在这项工作中,我们探索了图形神经PDEs的坚固性能。我们从经验上表明,图形神经PDEs与其他GNS相比,从本质上看,与其他GNS相比,它更能抵御表层突扰。我们通过利用图形表层扰动下的热半组的稳定性,对这一现象进行了深入了解。我们讨论了各种图形扩散操作器,并将其与现有的图形神经PDEs联系起来。此外,我们提议了一个通用的图形神经PDE框架,在此基础上可以确定一个新的强力GNNS类别。我们核实,新模型在一些基准数据集上取得了可比的状态性表现。