Existing cross-domain keypoint detection methods always require accessing the source data during adaptation, which may violate the data privacy law and pose serious security concerns. Instead, this paper considers a realistic problem setting called source-free domain adaptive keypoint detection, where only the well-trained source model is provided to the target domain. For the challenging problem, we first construct a teacher-student learning baseline by stabilizing the predictions under data augmentation and network ensembles. Built on this, we further propose a unified approach, Mixup Augmentation and Progressive Selection (MAPS), to fully exploit the noisy pseudo labels of unlabeled target data during training. On the one hand, MAPS regularizes the model to favor simple linear behavior in-between the target samples via self-mixup augmentation, preventing the model from over-fitting to noisy predictions. On the other hand, MAPS employs the self-paced learning paradigm and progressively selects pseudo-labeled samples from `easy' to `hard' into the training process to reduce noise accumulation. Results on four keypoint detection datasets show that MAPS outperforms the baseline and achieves comparable or even better results in comparison to previous non-source-free counterparts.
翻译:现有跨界关键点检测方法在适应期间总是需要访问源数据,这可能违反数据隐私法,并造成严重的安全关切。相反,本文件考虑一个现实的问题设置,称为无源域域适应性关键点检测,只有训练有素的源模式才提供给目标领域。对于挑战性问题,我们首先通过稳定数据增强和网络组合下的预测,建立一个师生学习基线。在此基础上,我们进一步提议一种统一办法,即混合增益和渐进选择(MAPS),以便在培训期间充分利用无标签目标数据的杂音假标签。一方面,MAPS规范了模型,以便通过自我混合增强,在目标样本之间支持简单的线性行为,防止模型过于适应噪音预测。另一方面,MAPS采用自我节奏学习模式,逐步从“易变硬”到“硬”的假标签样本选入培训过程,以减少噪音积累。四个关键点检测数据集的结果显示,MAPS系统在基线上超越或之前的对比结果。