Synthetic media detection technologies label media as either synthetic or non-synthetic and are increasingly used by journalists, web platforms, and the general public to identify misinformation and other forms of problematic content. As both well-resourced organizations and the non-technical general public generate more sophisticated synthetic media, the capacity for purveyors of problematic content to adapt induces a \newterm{detection dilemma}: as detection practices become more accessible, they become more easily circumvented. This paper describes how a multistakeholder cohort from academia, technology platforms, media entities, and civil society organizations active in synthetic media detection and its socio-technical implications evaluates the detection dilemma. Specifically, we offer an assessment of detection contexts and adversary capacities sourced from the broader, global AI and media integrity community concerned with mitigating the spread of harmful synthetic media. A collection of personas illustrates the intersection between unsophisticated and highly-resourced sponsors of misinformation in the context of their technical capacities. This work concludes that there is no "best" approach to navigating the detector dilemma, but derives a set of implications from multistakeholder input to better inform detection process decisions and policies, in practice.
翻译:合成媒体检测技术将媒体称为合成媒体或非合成媒体,并越来越多地被记者、网络平台和一般公众用来识别错误信息和其他形式的问题内容。由于资源充足的组织和非技术公众都产生更先进的合成媒体,有问题内容的传播者调适能力诱发了一种新的[检测进 困境}:随着检测方法变得更加容易获得,它们更容易被规避。本文描述了来自学术界、技术平台、媒体实体和民间社会组织的多方利益攸关方群体如何评估合成媒体检测及其社会-技术影响如何评估检测进困境。具体地说,我们评估了与减少有害合成媒体扩散有关的更广泛、全球AI和媒体廉正界的检测背景和对立能力。一个人的收集展示了在其技术能力范围内错误信息不精致和高度资源丰富的赞助者之间的交叉点。这项工作得出的结论是,没有“最佳”方法来引导检测进困境,但从多方利益攸关方的投入中产生了一系列影响,以便在实践中更好地为检测过程和政策提供信息。