This paper presents the results and analyses stemming from the first VoicePrivacy 2020 Challenge which focuses on developing anonymization solutions for speech technology. We provide a systematic overview of the challenge design with an analysis of submitted systems and evaluation results. In particular, we describe the voice anonymization task and datasets used for system development and evaluation. Also, we present different attack models and the associated objective and subjective evaluation metrics. We introduce two anonymization baselines and provide a summary description of the anonymization systems developed by the challenge participants. We report objective and subjective evaluation results for baseline and submitted systems. In addition, we present experimental results for alternative privacy metrics and attack models developed as a part of the post-evaluation analysis. Finally, we summarize our insights and observations that will influence the design of the next VoicePrivacy challenge edition and some directions for future voice anonymization research.
翻译:本文件介绍首个语音隐私2020挑战的成果和分析,重点是为语音技术开发匿名解决方案;我们系统地概述挑战设计,分析提交的系统和评价结果;特别是,我们介绍用于系统开发和评估的语音匿名任务和数据集;我们还介绍不同的攻击模型和相关客观和主观评价指标;我们介绍两个匿名基线,并简要描述挑战参与者开发的匿名系统;我们报告基线和已提交系统的客观和主观评价结果;此外,我们介绍作为评价后分析的一部分开发的替代隐私指标和攻击模型的实验结果;最后,我们总结将影响下一个语音隐私挑战版本的设计的见解和意见,以及未来语音匿名研究的一些方向。