Human pose estimation has achieved significant progress on images with high imaging resolution. However, low-resolution imagery data bring nontrivial challenges which are still under-studied. To fill this gap, we start with investigating existing methods and reveal that the most dominant heatmap-based methods would suffer more severe model performance degradation from low-resolution, and offset learning is an effective strategy. Established on this observation, in this work we propose a novel Confidence-Aware Learning (CAL) method which further addresses two fundamental limitations of existing offset learning methods: inconsistent training and testing, decoupled heatmap and offset learning. Specifically, CAL selectively weighs the learning of heatmap and offset with respect to ground-truth and most confident prediction, whilst capturing the statistical importance of model output in mini-batch learning manner. Extensive experiments conducted on the COCO benchmark show that our method outperforms significantly the state-of-the-art methods for low-resolution human pose estimation.
翻译:然而,低分辨率图像数据带来了尚未得到充分研究的非三重挑战。为了填补这一空白,我们首先调查现有方法,并揭示以热映射为基础的最主要方法将因低分辨率而遭受更严重的模型性能退化,而抵消学习是一项有效的战略。基于这一观察,我们提出了一个新的“信任软件学习”方法(CAL)方法,在这项工作中进一步解决了现有抵消学习方法的两个基本局限性:不协调的培训和测试、分解的热映射和抵消学习。具体地说,CAL有选择地衡量热映的学习,并在地面真相和最有信心的预测方面加以抵消,同时捕捉到模型输出的统计重要性,以微型批量学习方式进行的广泛实验表明,我们的方法大大优于低分辨率人造型估计的最先进方法。