In this paper, we address a new image forensics task, namely the detection of fake flood images generated by ClimateGAN architecture. We do so by proposing a hybrid deep learning architecture including both a detection and a localization branch, the latter being devoted to the identification of the image regions manipulated by ClimateGAN. Even if our goal is the detection of fake flood images, in fact, we found that adding a localization branch helps the network to focus on the most relevant image regions with significant improvements in terms of generalization capabilities and robustness against image processing operations. The good performance of the proposed architecture is validated on two datasets of pristine flood images downloaded from the internet and three datasets of fake flood images generated by ClimateGAN starting from a large set of diverse street images.
翻译:在本文中,我们处理一种新的图像法证任务,即探测ClimateGAN结构产生的假冒洪水图像,我们通过提出一个混合的深层学习结构,包括一个探测和本地化分支,后者专门用来识别ClimateGAN操纵的图像区域。即使我们的目标是探测假冒洪水图像,事实上,我们发现,增加一个本地化分支有助于网络关注最相关的图像区域,在一般化能力和抵御图像处理操作的稳健性方面大有改进。 拟议的架构的良好表现通过从互联网下载的两套原始洪水图像和ClimateGAN从大量多样街道图像开始产生的三套假冒洪水图像的数据集得到验证。