Information availability affects people's behavior and perception of the world. Notably, people rely on search engines to satisfy their need for information. Search engines deliver results relevant to user requests usually without being or making themselves accountable for the information they deliver, which may harm people's lives and, in turn, society. This potential risk urges the development of evaluation mechanisms of bias in order to empower the user in judging the results of search engines. In this paper, we give a possible solution to measuring representation bias with respect to societal features for search engines and apply it to evaluating the gender representation bias for Google's Knowledge Graph Carousel for listing occupations.
翻译:特别是,人们依靠搜索引擎来满足其信息需求; 搜索引擎提供与用户请求有关的结果,通常并不要求用户对其提供的信息负责,这可能会损害人们的生活,反过来也危害社会; 这种潜在风险促使建立偏见评价机制,以便增强用户判断搜索引擎结果的能力; 在本文件中,我们提供了一种可能的解决办法,用以衡量与搜索引擎的社会特征有关的代表偏向,并将其用于评估谷歌知识图卡卢塞尔在列出职业方面的性别代表偏向。