The main challenges of ReID is the intra-class variations caused by color deviation under different camera conditions. Simultaneously, we find that most of the existing adversarial metric attacks are realized by interfering with the color characteristics of the sample. Based on this observation, we first propose a local transformation attack (LTA) based on color variation. It uses more obvious color variation to randomly disturb the color of the retrieved image, rather than adding random noise. Experiments show that the performance of the proposed LTA method is better than the advanced attack methods. Furthermore, considering that the contour feature is the main factor of the robustness of adversarial training, and the color feature will directly affect the success rate of attack. Therefore, we further propose joint adversarial defense (JAD) method, which include proactive defense and passive defense. Proactive defense fuse multi-modality images to enhance the contour feature and color feature, and considers local homomorphic transformation to solve the over-fitting problem. Passive defense exploits the invariance of contour feature during image scaling to mitigate the adversarial disturbance on contour feature. Finally, a series of experimental results show that the proposed joint adversarial defense method is more competitive than a state-of-the-art methods.
翻译:ReID的主要挑战在于不同相机条件下的颜色偏差导致的阶级内部差异。 同时, 我们发现大多数现有的对抗性矩阵攻击是通过干扰样本的颜色特性来实现的。 基于此观察, 我们首先提议基于颜色差异的局部变换攻击( LTA ) 。 它使用更明显的颜色变异来随机扰动检索到的图像的颜色, 而不是添加随机噪音。 实验显示, 拟议的长期协议方法的性能比先进的攻击方法要好。 此外, 考虑到轮廓特征是对抗性训练的稳健性的主要因素, 而颜色特征将直接影响攻击的成功率。 因此, 我们进一步提出联合对抗性防御( JAD) 方法, 其中包括主动防御和被动防御。 主动性防御结合多模式图像, 以强化调色特征和颜色特征, 并考虑本地的同质形态变异性变化来解决过度的问题。 被动防御利用图像缩放期间的轮廓特征的异性来减轻轮廓特征的对抗性扰动性。 最后, 一系列实验性结果显示, 联合对抗性防御方法是比联合防御方法更具有竞争力的方法。