Many recommendation systems rely on point-wise models, which score items individually. However, point-wise models generating scores for a video are unable to account for other videos being recommended in a query. Due to this, diversity has to be introduced through the application of heuristic-based rules, which are not able to capture user preferences, or make balanced trade-offs in terms of diversity and item relevance. In this paper, we propose a novel method which introduces diversity by modeling the impact of low diversity on user's engagement on individual items, thus being able to account for both diversity and relevance to adjust item scores. The proposed method is designed to be easily pluggable into existing large-scale recommender systems, while introducing minimal changes in the recommendations stack. Our models show significant improvements in offline metrics based on the normalized cross entropy loss compared to production point-wise models. Our approach also shows a substantial increase of 1.7% in topline engagements coupled with a 1.5% increase in daily active users in an A/B test with live traffic on Facebook Watch, which translates into an increase of millions in the number of daily active users for the product.
翻译:许多推荐系统依赖于基于点的模型,这些模型单独为每个项目进行评分。然而,为视频生成分数的基于点的模型无法考虑到在查询中推荐的其他视频。由于这一点,必须通过启发式规则引入多样性,而这些规则无法捕捉用户偏好或在多样性和项目相关性方面进行平衡的权衡。在本文中,我们提出了一种新颖的方法,通过建模低多样性对用户对单个项目的参与度的影响来引入多样性,从而能够考虑到多样性和相关性以调整项目分数。所提出的方法旨在轻松插入现有的大规模推荐系统中,同时在推荐堆栈中引入最小的变化。与生产基于点的模型相比,我们的模型在基于标准化交叉熵损失的离线指标上显示出显著的改进。在Facebook Watch上的实时流量的A/B测试中,我们的方法还显示了总体参与度的显著增加1.7%,以及日活跃用户的1.5%增长,这转化为每天数百万的日活跃用户数量的增长。