Photorealistic image generation has reached a new level of quality due to the breakthroughs of generative adversarial networks (GANs). Yet, the dark side of such deepfakes, the malicious use of generated media, raises concerns about visual misinformation. While existing research work on deepfake detection demonstrates high accuracy, it is subject to advances in generation techniques and adversarial iterations on detection countermeasure techniques. Thus, we seek a proactive and sustainable solution on deepfake detection, that is agnostic to the evolution of generative models, by introducing artificial fingerprints into the models. Our approach is simple and effective. We first embed artificial fingerprints into training data, then validate a surprising discovery on the transferability of such fingerprints from training data to generative models, which in turn appears in the generated deepfakes. Experiments show that our fingerprinting solution (1) holds for a variety of cutting-edge generative models, (2) leads to a negligible side effect on generation quality, (3) stays robust against image-level and model-level perturbations, (4) stays hard to be detected by adversaries, and (5) converts deepfake detection and attribution into trivial tasks and outperforms the recent state-of-the-art baselines. Our solution closes the responsibility loop between publishing pre-trained generative model inventions and their possible misuses, which makes it independent of the current arms race.
翻译:由于基因对抗网络(GANs)的突破,摄影现实形象的生成达到了一个新的质量水平。然而,这种深假网络的阴暗面,对产生的媒体的恶意使用,引起了对视觉错误信息的担忧。虽然关于深假探测的现有研究工作显示高度精度,但是在探测反措施技术的生成技术和对抗性迭代方面有进步。因此,我们寻求在深假检测方面采取积极主动和可持续的解决办法,这种解决办法通过在模型中引入人工指纹,对基因改变模式的演变具有不可知觉性。我们的方法是简单而有效的。我们首先在培训数据中嵌入人工指纹,然后证实关于这种指纹从培训数据向基因模型转移的惊人发现,而这种发现又在生成的深度假冒模型中出现。实验表明,我们的指纹解决方案(1) 具有各种尖端基因对抗技术的尖端模型,(2) 导致对生成质量产生微不足道的副作用,(3) 与图像水平和模型级的破坏力保持稳健,(4) 对手难以检测,以及(5) 将深假指纹的模型探测和归属转变为微不足道的当前武器模型和归属模式的可转让性模型,从而导致我们最近可能实现的版本的责任。