Geometric image transformations that arise in the real world, such as scaling and rotation, have been shown to easily deceive deep neural networks (DNNs). Hence, training DNNs to be certifiably robust to these perturbations is critical. However, no prior work has been able to incorporate the objective of deterministic certified robustness against geometric transformations into the training procedure, as existing verifiers are exceedingly slow. To address these challenges, we propose the first provable defense for deterministic certified geometric robustness. Our framework leverages a novel GPU-optimized verifier that can certify images between 60$\times$ to 42,600$\times$ faster than existing geometric robustness verifiers, and thus unlike existing works, is fast enough for use in training. Our results across multiple datasets show that networks trained via our framework consistently achieve state-of-the-art deterministic certified geometric robustness and clean accuracy. Furthermore, for the first time, we verify the geometric robustness of a neural network for the challenging, real-world setting of autonomous driving.
翻译:在现实世界中出现的几何图像转换,例如缩放和旋转,被证明很容易欺骗深神经网络(DNNS)。因此,培训DNS对于这些扰动至关重要。然而,以往没有一项工作能够将确定性、经核证的稳健性目标纳入培训程序,因为现有的核查员极其缓慢。为了应对这些挑战,我们提议为确定性、经核证的几何稳健性提供第一个可辨辨识的防御。我们的框架利用了一个新型的GPU-优化验证器,该验证器可以比现有的几何稳健性验证器更快地证明60美元到42 600美元之间的图像,因此与现有的工程不同,在培训中已经足够快。我们跨越多个数据集的结果表明,通过我们框架培训的网络始终能够达到最先进的确定性、经核证的几何计量稳健性和清洁准确性。此外,我们第一次核实了在具有挑战性的、真实的驱动力世界环境中的神经网络的几何度稳健性。