Geometric deep learning has sparked a rising interest in computer graphics to perform shape understanding tasks, such as shape classification and semantic segmentation. When the input is a polygonal surface, one has to suffer from the irregular mesh structure. Motivated by the geometric spectral theory, we introduce Laplacian2Mesh, a novel and flexible convolutional neural network (CNN) framework for coping with irregular triangle meshes (vertices may have any valence). By mapping the input mesh surface to the multi-dimensional Laplacian-Beltrami space, Laplacian2Mesh enables one to perform shape analysis tasks directly using the mature CNNs, without the need to deal with the irregular connectivity of the mesh structure. We further define a mesh pooling operation such that the receptive field of the network can be expanded while retaining the original vertex set as well as the connections between them. Besides, we introduce a channel-wise self-attention block to learn the individual importance of feature ingredients. Laplacian2Mesh not only decouples the geometry from the irregular connectivity of the mesh structure but also better captures the global features that are central to shape classification and segmentation. Extensive tests on various datasets demonstrate the effectiveness and efficiency of Laplacian2Mesh, particularly in terms of the capability of being vulnerable to noise to fulfill various learning tasks.
翻译:几何深度学习在计算机图形学领域中引起了越来越多的兴趣,包括形状分类和语义分割等形状理解任务。当输入是一个多边形表面时,人们必须忍受不规则网格结构的困扰。受几何谱理论的启发,我们引入了 Laplacian2Mesh,一种新颖灵活的卷积神经网络(CNN)框架,用于应对不规则三角形网格(顶点可能具有任何价值)的问题。通过将输入网格表面映射到多维拉普拉斯-贝尔特拉米空间,Laplacian2Mesh使得我们能够使用成熟的CNN直接执行形状分析任务,而无需处理网格结构的不规则连接。我们进一步定义了一个网格池化操作,使得网络的感受野可以扩展,同时保留原始顶点集以及它们之间的连接。此外,我们引入了一个通道智能自注意力块,以学习特征成分的个体重要性。Laplacian2Mesh不仅将几何体系与不规则网格结构解耦,而且能够更好地捕捉与形状分类和分割密切相关的全局特征。在各种数据集上的广泛测试证明了Laplacian2Mesh的有效性和效率,特别是在容易受到噪声影响以完成各种学习任务方面。