3D point cloud models are widely applied in safety-critical scenes, which delivers an urgent need to obtain more solid proofs to verify the robustness of models. Existing verification method for point cloud model is time-expensive and computationally unattainable on large networks. Additionally, they cannot handle the complete PointNet model with joint alignment network (JANet) that contains multiplication layers, which effectively boosts the performance of 3D models. This motivates us to design a more efficient and general framework to verify various architectures of point cloud models. The key challenges in verifying the large-scale complete PointNet models are addressed as dealing with the cross-non-linearity operations in the multiplication layers and the high computational complexity of high-dimensional point cloud inputs and added layers. Thus, we propose an efficient verification framework, 3DVerifier, to tackle both challenges by adopting a linear relaxation function to bound the multiplication layer and combining forward and backward propagation to compute the certified bounds of the outputs of the point cloud models. Our comprehensive experiments demonstrate that 3DVerifier outperforms existing verification algorithms for 3D models in terms of both efficiency and accuracy. Notably, our approach achieves an orders-of-magnitude improvement in verification efficiency for the large network, and the obtained certified bounds are also significantly tighter than the state-of-the-art verifiers. We release our tool 3DVerifier via https://github.com/TrustAI/3DVerifier for use by the community.
翻译:3D点云模型被广泛应用在安全临界场景中,因此迫切需要获得更可靠的证据,以核实模型的稳健性。点云模型的现有核查方法是时间成本昂贵的,在大型网络上无法实现的计算方法。此外,它们无法用包含乘数层的联合匹配网络(JANet)处理完整的点网模型,这有效地提升了3D模型的性能。这促使我们设计一个更高效、更普遍的框架,以核查点云模型的各种结构。在核实大规模完整的点网模型方面的主要挑战,是处理倍增层的跨非线性操作以及高维点云输入和添加层的高度计算复杂性。因此,我们提出了一个高效的PointNet模型(JANet)和包含乘数层的联合协调网络(JANet),通过采用线性放松功能来约束倍增数层,以及将前向和后向传播结合起来,以计算点云模型产出的经认证的界限。我们的全面实验表明,3DVerifter将现有三D模型的核查算出现有三D模型的校验算法,通过更精确度的方法,我们通过更精确的网络系统系统系统提高了网络的校验测效率和认证工具。