EvalRS aims to bring together practitioners from industry and academia to foster a debate on rounded evaluation of recommender systems, with a focus on real-world impact across a multitude of deployment scenarios. Recommender systems are often evaluated only through accuracy metrics, which fall short of fully characterizing their generalization capabilities and miss important aspects, such as fairness, bias, usefulness, informativeness. This workshop builds on the success of last year's workshop at CIKM, but with a broader scope and an interactive format.
翻译:EvalRS旨在汇集业界和学术界的实践者,促进对推荐系统全面评估的讨论,重点是跨多种部署场景的实际影响。推荐系统通常仅通过准确度指标进行评估,这些指标不能完全表征它们的泛化能力,并且忽略了重要因素,例如公平性、偏见、有用性和信息量。本次研讨会基于去年在CIKM的成功,但具有更广泛的范围和互动形式。