Software systems are vulnerable to fairness bugs and frequently exhibit unfair behaviors, making software fairness an increasingly important concern for software engineers. Research has focused on helping software engineers to detect fairness bugs automatically. This paper provides a comprehensive survey of existing research on fairness testing. We collect 122 papers and organise them based on the testing workflow (i.e., the testing activities) and the testing components (i.e., where to find fairness bugs) for conducting fairness testing. We also analyze the research focus, trends, promising directions, as well as widely-adopted datasets and open source tools for fairness testing.
翻译:软件系统容易受到公平错误的影响,而且经常表现出不公平的行为,使软件公平成为软件工程师越来越关注的重要事项。研究的重点是帮助软件工程师自动发现公平错误。本文对公平测试的现有研究进行了全面调查。我们收集了122份文件,并根据测试工作流程(即测试活动)和进行公平测试的测试组成部分(即在哪里找到公平错误)组织这些文件。我们还分析了研究重点、趋势、有希望的方向以及广泛采用的数据集和公开源码工具,以便进行公平测试。