In this paper, we delve into semi-supervised 2D human pose estimation. The previous method ignored two problems: (i) When conducting interactive training between large model and lightweight model, the pseudo label of lightweight model will be used to guide large models. (ii) The negative impact of noise pseudo labels on training. Moreover, the labels used for 2D human pose estimation are relatively complex: keypoint category and keypoint position. To solve the problems mentioned above, we propose a semi-supervised 2D human pose estimation framework driven by a position inconsistency pseudo label correction module (SSPCM). We introduce an additional auxiliary teacher and use the pseudo labels generated by the two teacher model in different periods to calculate the inconsistency score and remove outliers. Then, the two teacher models are updated through interactive training, and the student model is updated using the pseudo labels generated by two teachers. To further improve the performance of the student model, we use the semi-supervised Cut-Occlude based on pseudo keypoint perception to generate more hard and effective samples. In addition, we also proposed a new indoor overhead fisheye human keypoint dataset WEPDTOF-Pose. Extensive experiments demonstrate that our method outperforms the previous best semi-supervised 2D human pose estimation method. We will release the code and dataset at https://github.com/hlz0606/SSPCM.
翻译:在本文中,我们深入到半监督的2D人构成估计中。前一种方法忽略了两个问题:(一) 当在大型模型和轻量模型之间进行互动培训时,将使用轻量模型的假标签来指导大型模型;(二) 噪声假标签对培训的负面影响。此外,2D人构成估计使用的标签相对复杂:关键点类别和关键点位置。为了解决上述问题,我们提议了一个半监督的2D人构成估计框架,由位置不一致的伪标签校正模块(SSPCM)驱动。我们引入了额外的辅助教师,并使用两个教师模型在不同时期产生的假标签来计算不一致分数和清除外层。随后,两个教师模型通过互动培训更新,学生模型使用两名教师生成的假标签进行更新。为了进一步改善学生模型的性能,我们使用基于假称关键点认知的半监督的Cut-Oclude 来生成更硬和更有效的样本。此外,我们还提议了一个新的室内上层渔场人类关键SP2号高级数据模型,我们将展示我们之前的版本。</s>