We revisit the application of predictive models by the Chicago Department of Public Health to schedule restaurant inspections and prioritize the detection of critical violations of the food code. Performing the first analysis from the perspective of fairness to the population served by the restaurants, we find that the model treats inspections unequally based on the sanitarian who conducted the inspection and that in turn there are both geographic and demographic disparities in the benefits of the model. We examine both approaches to use the original model in a fairer way and ways to train the model to achieve fairness and find more success with the former class of approaches. The challenges from this application point to important directions for future work around fairness with collective entities rather than individuals, the use of critical violations as a proxy, and the disconnect between fair classification and fairness in the dynamic scheduling system.
翻译:我们重新审视芝加哥公共卫生部应用预测模型安排餐厅检查和优先发现严重违反食品守则的行为。我们从对餐馆服务的人口公平的角度进行第一次分析,发现该模型对检查的处理不平等,其依据是进行检查的精神病人,反过来,该模型的惠益在地理和人口上都存在差异。我们审视了两种方法,即以更公平的方式使用原始模型,以及如何培训模型,以实现公平,并找到与前一类方法更成功的方法。从这一应用中,挑战指向今后围绕与集体实体而不是个人公平、使用严重违规行为作为代理以及动态列表系统公平分类和公平之间的脱节开展工作的重要方向。