As a popular geometric representation, point clouds have attracted much attention in 3D vision, leading to many applications in autonomous driving and robotics. One important yet unsolved issue for learning on point cloud is that point clouds of the same object can have significant geometric variations if generated using different procedures or captured using different sensors. These inconsistencies induce domain gaps such that neural networks trained on one domain may fail to generalize on others. A typical technique to reduce the domain gap is to perform adversarial training so that point clouds in the feature space can align. However, adversarial training is easy to fall into degenerated local minima, resulting in negative adaptation gains. Here we propose a simple yet effective method for unsupervised domain adaptation on point clouds by employing a self-supervised task of learning geometry-aware implicits, which plays two critical roles in one shot. First, the geometric information in the point clouds is preserved through the implicit representations for downstream tasks. More importantly, the domain-specific variations can be effectively learned away in the implicit space. We also propose an adaptive strategy to compute unsigned distance fields for arbitrary point clouds due to the lack of shape models in practice. When combined with a task loss, the proposed outperforms state-of-the-art unsupervised domain adaptation methods that rely on adversarial domain alignment and more complicated self-supervised tasks. Our method is evaluated on both PointDA-10 and GraspNet datasets. The code and trained models will be publicly available.
翻译:作为广受欢迎的几何代表,点云在3D愿景中引起了人们的极大关注,导致在自主驱动和机器人中有许多应用。在点云上学习的一个重要但尚未解决的问题是,同一对象的点云如果使用不同的程序产生,或者使用不同的传感器捕捉到,可能会产生重大的几何变化。这些不一致导致领域差距,使在一个领域受过训练的神经网络可能无法对其它领域进行概括化。缩小域间差距的典型技术是进行对抗性培训,这样可以使特征空间中的点云能够相互配合。然而,对抗性培训很容易落入退化的地方迷你迷你,从而产生消极的适应效果。我们在这里提出了一个简单而有效的方法,通过使用自我监督的学习几何测觉暗隐含的任务来对点云进行不受监督的域域内适应。首先,点云中的几何信息可以通过隐含的下游任务的表达方式得以保存。更重要的是,特定域内空的变异可以有效地在隐含空间中学习。我们还提出了一种适应性战略,用以将未指派的距离域域域域域域域内云进行任意的计算,因为缺乏精确度的公示的域间校正校正校正的校正校正的校正的校正的校正模型,在我们的域校正的校正的校正的校正的校正模式上,在我们的域内模型的校正的校正的校正的校正的校正的校正的校正的校正。