Unsupervised domain adaptive object detection is a challenging vision task where object detectors are adapted from a label-rich source domain to an unlabeled target domain. Recent advances prove the efficacy of the adversarial based domain alignment where the adversarial training between the feature extractor and domain discriminator results in domain-invariance in the feature space. However, due to the domain shift, domain discrimination, especially on low-level features, is an easy task. This results in an imbalance of the adversarial training between the domain discriminator and the feature extractor. In this work, we achieve a better domain alignment by introducing an auxiliary regularization task to improve the training balance. Specifically, we propose Adversarial Image Reconstruction (AIR) as the regularizer to facilitate the adversarial training of the feature extractor. We further design a multi-level feature alignment module to enhance the adaptation performance. Our evaluations across several datasets of challenging domain shifts demonstrate that the proposed method outperforms all previous methods, of both one- and two-stage, in most settings.
翻译:无监督领域自适应目标检测是一项具有挑战性的视觉任务,目标检测器需要从标签丰富的源领域自适应到未标记的目标领域。最近的研究表明,基于对抗的领域对齐技术是有效的方法,其中特征提取器和领域鉴别器之间的对抗训练可以在特征空间中产生领域不变性。然而,由于领域偏移,领域鉴别,特别是在低级特征上,是一项简单的任务。这导致在领域鉴别器和特征提取器之间的对抗训练中存在平衡失调。在本文中,我们通过引入辅助正则化任务来改善训练平衡,从而实现更好的领域对齐。具体而言,我们提出对抗图像重建(AIR)作为正则化器,以促进特征提取器的对抗训练。我们还设计了一个多层特征对齐模块,以增强自适应性能。我们在几个具有挑战性领域偏移的数据集上的评估表明,所提出的方法在大多数情况下优于以前的所有一阶段和二阶段方法。