Cloth-changing person reidentification (ReID) is a newly emerging research topic that is aimed at addressing the issues of large feature variations due to cloth-changing and pedestrian view/pose changes. Although significant progress has been achieved by introducing extra information (e.g., human contour sketching information, human body keypoints, and 3D human information), cloth-changing person ReID is still challenging due to impressionable pedestrian representations. Moreover, human semantic information and pedestrian identity information are not fully explored. To solve these issues, we propose a novel identity-guided collaborative learning scheme (IGCL) for cloth-changing person ReID, where the human semantic is fully utilized and the identity is unchangeable to guide collaborative learning. First, we design a novel clothing attention degradation stream to reasonably reduce the interference caused by clothing information where clothing attention and mid-level collaborative learning are employed. Second, we propose a human semantic attention and body jigsaw stream to highlight the human semantic information and simulate different poses of the same identity. In this way, the extraction features not only focus on human semantic information that is unrelated to the background but also are suitable for pedestrian pose variations. Moreover, a pedestrian identity enhancement stream is further proposed to enhance the identity importance and extract more favorable identity robust features. Most importantly, all these streams are jointly explored in an end-to-end unified framework, and the identity is utilized to guide the optimization. Extensive experiments on five public clothing person ReID datasets demonstrate that the proposed IGCL significantly outperforms SOTA methods and that the extracted feature is more robust, discriminative, and clothing-irrelevant.
翻译:更换服装人员再识别(ReID)是一个新兴的研究课题,旨在解决由于更换服装和行人视图/姿势的变化而导致的特征差异大的问题。尽管通过引入额外的信息(例如人体轮廓素描信息、人体关键点和3D人体信息)已经取得了显著的进展,但由于易受干扰的行人表示,更换服装人员ReID仍然具有挑战性。此外,人类语义信息和行人身份信息也没有得到充分的探究。为解决这些问题,我们提出了一种新颖的身份引导协作学习方案(IGCL)用于更换服装人员ReID,其中充分利用了人类语义信息和身份无法更改的身份来指导协作学习。首先,我们设计了一种新颖的服装注意力减弱流以合理地减少由服装信息引起的干扰,采用了服装关注度和中层协作学习。其次,我们提出了人类语义关注度和身体拼图流以突出人类语义信息并模拟相同身份的不同姿势。这样,提取的特征不仅专注于与背景无关的人类语义信息,还适合于行人姿态变化。此外,进一步提出了行人身份增强流,以增强身份重要性并提取更有利的身份抗干扰特征。最重要的是,所有这些流在端到端统一框架中共同探索,利用身份来指导优化。在五个公共服装人员ReID数据集上的广泛实验表明,所提出的IGCL显著优于SOTA方法,并且提取的特征更加强健、有区别性和与服装无关。