Cheapfake is a recently coined term that encompasses non-AI ("cheap") manipulations of multimedia content. Cheapfakes are known to be more prevalent than deepfakes. Cheapfake media can be created using editing software for image/video manipulations, or even without using any software, by simply altering the context of an image/video by sharing the media alongside misleading claims. This alteration of context is referred to as out-of-context (OOC) misuse of media. OOC media is much harder to detect than fake media, since the images and videos are not tampered. In this challenge, we focus on detecting OOC images, and more specifically the misuse of real photographs with conflicting image captions in news items. The aim of this challenge is to develop and benchmark models that can be used to detect whether given samples (news image and associated captions) are OOC, based on the recently compiled COSMOS dataset.
翻译:廉价伪造品是一个新近流行的词汇,指非人工智能("cheap")多媒体内容的篡改。廉价伪造品比起深度伪造品更加普遍。廉价伪造品媒体可以使用图像/视频编辑软件进行编辑,甚至不需要使用任何软件,通过在误导性内容旁边共享媒体来改变图像/视频的上下文。这种上下文的改变被称为媒体的脱离上下文(out-of-context, OOC)误用。OOC媒体比起假媒体更难检测,因为图像和视频没有被篡改。在这场挑战中,我们专注于检测OOC图像,更具体地说是在新闻项目中使用有冲突的图像标题滥用真实照片。这项挑战的目的是开发和基准测试可以用于检测给定样本(新闻图像和相关标题)是否OOC的模型,基于最近编译的COSMOS数据集。