Scandinavian countries are perceived as role-models when it comes to gender equality. With the advent of pre-trained language models and their widespread usage, we investigate to what extent gender-based harmful and toxic content exist in selected Scandinavian language models. We examine nine models, covering Danish, Swedish, and Norwegian, by manually creating template-based sentences and probing the models for completion. We evaluate the completions using two methods for measuring harmful and toxic completions and provide a thorough analysis of the results. We show that Scandinavian pre-trained language models contain harmful and gender-based stereotypes with similar values across all languages. This finding goes against the general expectations related to gender equality in Scandinavian countries and shows the possible problematic outcomes of using such models in real-world settings.
翻译:在性别平等方面,斯堪的纳维亚国家被视为榜样。随着培训前语言模式的出现及其广泛使用,我们调查选定斯堪的纳维亚语言模式中基于性别的有害和有毒内容在多大程度上存在。我们通过人工创建基于模板的句子和测试完成模式,对包括丹麦、瑞典和挪威在内的九种模式进行了审查。我们用两种方法评估完成的成绩,衡量有害和有毒的完成情况,并对结果进行透彻的分析。我们显示,斯堪的纳维亚培训前语言模式中含有有害的和基于性别的陈规定型观念,在所有语言中都具有类似的价值观。这一发现与斯堪的纳维亚国家有关性别平等的普遍期望背道而驰,并显示在现实世界环境中使用此类模式可能产生的问题结果。