The TREC Fair Ranking Track aims to provide a platform for participants to develop and evaluate novel retrieval algorithms that can provide a fair exposure to a mixture of demographics or attributes, such as ethnicity, that are represented by relevant documents in response to a search query. For example, particular demographics or attributes can be represented by the documents' topical content or authors. The 2021 Fair Ranking Track adopted a resource allocation task. The task focused on supporting Wikipedia editors who are looking to improve the encyclopedia's coverage of topics under the purview of a WikiProject. WikiProject coordinators and/or Wikipedia editors search for Wikipedia documents that are in need of editing to improve the quality of the article. The 2021 Fair Ranking track aimed to ensure that documents that are about, or somehow represent, certain protected characteristics receive a fair exposure to the Wikipedia editors, so that the documents have an fair opportunity of being improved and, therefore, be well-represented in Wikipedia. The under-representation of particular protected characteristics in Wikipedia can result in systematic biases that can have a negative human, social, and economic impact, particularly for disadvantaged or protected societal groups.
翻译:TREC 公平排名轨道旨在为参与者提供一个平台,以开发和评价能够公平地暴露于人口或属性(如族裔)混合的新检索算法,这些算法由相关文件针对搜索询问而代表,例如,特定的人口或属性可以由文件的主题内容或作者代表,2021年公平排名轨道通过了一项资源分配任务,重点是支持维基百科编辑,他们正寻求改进百科全书对Wiki项目范围内专题的涵盖范围。维基百科项目协调员和/或维基百科编辑寻找需要编辑的维基百科文件,以提高文章的质量。2021年公平排名轨道旨在确保接近或以某种方式代表某些受保护特征的文件能够公平地接触到维基百科编辑,从而使这些文件有相当的机会得到改进,从而在维基百科中得到充分代表。维基百科中特别受保护特征的任职人数不足,可能导致系统性的偏见,对人、社会和经济产生负面影响,尤其是对弱势或受保护的社会群体产生负面影响。