We investigate the potential of fusing human examiner decisions for the task of digital face manipulation detection. To this end, various decision fusion methods are proposed incorporating the examiners' decision confidence, experience level, and their time to take a decision. Conducted experiments are based on a psychophysical evaluation of digital face image manipulation detection capabilities of humans in which different manipulation techniques were applied, i.e. face morphing, face swapping and retouching. The decisions of 223 participants were fused to simulate crowds of up to seven human examiners. Experimental results reveal that (1) despite the moderate detection performance achieved by single human examiners, a high accuracy can be obtained through decision fusion and (2) a weighted fusion which takes the examiners' decision confidence into account yields the most competitive detection performance.
翻译:我们调查了在数字面部操纵检测任务中将人检官决定引信化的可能性,为此,提出了各种决定集成方法,其中纳入了考官的决定信心、经验水平及其作出决定的时间。进行实验的基础是对人的数字面部图像操纵检测能力进行心理物理评估,其中应用了不同的操作技术,即面部变形、面部转换和重新触摸。223名参与者的决定被结合到模拟多达7名人检官的人群中。实验结果显示:(1) 尽管单人检官取得了适度的检测性能,但通过决定集成和(2)加权聚合可以取得高度的准确性,其中考虑到考官的决定性能,将考官的决定性能纳入到最有竞争力的检测性能中。