Although unsupervised feature learning has demonstrated its advantages to reducing the workload of data labeling and network design in many fields, existing unsupervised 3D learning methods still cannot offer a generic network for various shape analysis tasks with competitive performance to supervised methods. In this paper, we propose an unsupervised method for learning a generic and efficient shape encoding network for different shape analysis tasks. The key idea of our method is to jointly encode and learn shape and point features from unlabeled 3D point clouds. For this purpose, we adapt HR-Net to octree-based convolutional neural networks for jointly encoding shape and point features with fused multiresolution subnetworks and design a simple-yet-efficient Multiresolution Instance Discrimination (MID) loss for jointly learning the shape and point features. Our network takes a 3D point cloud as input and output both shape and point features. After training, the network is concatenated with simple task-specific back-end layers and fine-tuned for different shape analysis tasks. We evaluate the efficacy and generality of our method and validate our network and loss design with a set of shape analysis tasks, including shape classification, semantic shape segmentation, as well as shape registration tasks. With simple back-ends, our network demonstrates the best performance among all unsupervised methods and achieves competitive performance to supervised methods, especially in tasks with a small labeled dataset. For fine-grained shape segmentation, our method even surpasses existing supervised methods by a large margin.
翻译:尽管未经监督的特性学习表明它具有减少许多领域数据标签和网络设计工作量的优势,但现有的未经监督的3D学习方法仍然不能提供一个通用的网络,用于执行各种有竞争力的形状分析任务。在本文件中,我们建议了一种未经监督的方法,用于学习通用的高效形状编码网络,用于不同的形状分析任务。我们的方法的关键思想是联合编码和学习来自未标记的 3D 点云的形状和点特征。为此,我们调整了HR-Net,使之适应基于树枝的螺旋神经网络,以便与多分辨率子网络联合对形状和点特性进行编码,并设计一个简单而高效的多分辨率测试(MID)损失,用于共同学习形状和点特性。我们的网络将一个3D点云作为输入和输出的形状分析网络形状和点特性。经过培训后,网络以简单的任务特定的后端层层为组合,为不同的形状分析任务进行精细化。我们评估方法的效能和一般性能,并校准我们的网络和损失设计,特别用一套形状分析任务的精细的形状分析任务,包括形状的形状、缩式的分类、缩式的进度,以显示整个网络的进度、缩化的进度,作为整个的进度的进度,以显示、缩成成的进度,以显示的进度的进度的进度,以所有的分类、缩成成成成成的进度,以最细的分类和细的网络的分类。