Unsupervised domain adaptation for point cloud semantic segmentation has attracted great attention due to its effectiveness in learning with unlabeled data. Most of existing methods use global-level feature alignment to transfer the knowledge from the source domain to the target domain, which may cause the semantic ambiguity of the feature space. In this paper, we propose a graph-based framework to explore the local-level feature alignment between the two domains, which can reserve semantic discrimination during adaptation. Specifically, in order to extract local-level features, we first dynamically construct local feature graphs on both domains and build a memory bank with the graphs from the source domain. In particular, we use optimal transport to generate the graph matching pairs. Then, based on the assignment matrix, we can align the feature distributions between the two domains with the graph-based local feature loss. Furthermore, we consider the correlation between the features of different categories and formulate a category-guided contrastive loss to guide the segmentation model to learn discriminative features on the target domain. Extensive experiments on different synthetic-to-real and real-to-real domain adaptation scenarios demonstrate that our method can achieve state-of-the-art performance.
翻译:由于在学习无标签数据方面的有效性,对点云语系的未监督域适应引起了极大关注。大多数现有方法使用全球一级的特征调整,将知识从源域转移到目标域,这可能造成特征空间的语义模糊性。在本文件中,我们提议了一个基于图形的框架,以探讨这两个域之间的地方性特征调整,这可以在适应过程中保留语义歧视。具体地说,为了提取本地层面的特征,我们首先在两个域上动态地构建本地特征图,并用源域的图形建立存储库。特别是,我们利用最佳的传输方式生成图形匹配对配对。然后,根据任务矩阵,我们可以将两个域之间的特征分布与基于图形的本地特征损失相协调。此外,我们考虑不同类别特征之间的关联性,并制定一个类别制导对比性损失,以指导分解模型学习目标域的歧视性特征。在不同的合成到现实和真实到现实域域的适应情景上进行了广泛的实验。我们的方法可以实现状态性业绩。