3D human pose estimation is still a challenging problem despite the large amount of work that has been done in this field. Generally, most methods directly use neural networks and ignore certain constraints (e.g., reprojection constraints and joint angle and bone length constraints). This paper proposes a weakly supervised GAN-based model for 3D human pose estimation that considers 3D information along with 2D information simultaneously, in which a reprojection network is employed to learn the mapping of the distribution from 3D poses to 2D poses. In particular, we train the reprojection network and the generative adversarial network synchronously. Furthermore, inspired by the typical kinematic chain space (KCS) matrix, we propose a weighted KCS matrix, which is added into the discriminator's input to impose joint angle and bone length constraints. The experimental results on Human3.6M show that our method outperforms state-of-the-art methods by approximately 5.1\%.
翻译:3D 人体构成估计尽管在这一领域已经做了大量工作,但仍然是一个具有挑战性的问题。一般而言,大多数方法直接使用神经网络,忽视某些限制(如再预测限制和共同角度和骨长度限制)。本文件提议为3D 人体构成估计采用一个监督不力的GAN基模型,该模型同时考虑3D信息以及2D信息,在这个模型中,利用一个再预测网络了解3D向2D的分布分布图。特别是,我们同步地培训重新预测网络和基因对抗网络。此外,在典型的动态链空间矩阵的启发下,我们提议了一个加权 KCSS矩阵,加入歧视者的投入中,以施加共同角度和骨长度限制。关于HR3.6M的实验结果显示,我们的方法比最新方法的大约5.1 ⁇ 好。