In modern advertising and recommender systems, multi-task learning (MTL) paradigm has been widely employed to jointly predict diverse user feedbacks (e.g. click and purchase). While, existing MTL approaches are either rigid to adapt to different scenarios, or only capture coarse-grained task relatedness, thus making it difficult to effectively transfer knowledge across tasks. To address these issues, in this paper, we propose an Adaptive Fine-grained Task Relatedness modeling approach, AdaFTR, for joint CTR-CVR estimation. Our approach is developed based on a parameter-sharing MTL architecture, and introduces a novel adaptive inter-task representation alignment method based on contrastive learning.Given an instance, the inter-task representations of the same instance are considered as positive, while the representations of another random instance are considered as negative. Furthermore, we explicitly model fine-grained task relatedness as the contrast strength (i.e. the temperature coefficient in InfoNCE loss) at the instance level. For this purpose, we build a relatedness prediction network, so that it can predict the contrast strength for inter-task representations of an instance. In this way, we can adaptively set the temperature for contrastive learning in a fine-grained way (i.e. instance level), so as to better capture task relatedness. Both offline evaluation with public e-commerce datasets and online test in a real advertising system at Alibaba have demonstrated the effectiveness of our approach.
翻译:在现代广告和建议系统中,多任务学习(MTL)范式被广泛用于共同预测不同的用户反馈(例如点击和购买)。虽然现有的MTL方法要么僵硬,难以适应不同的情景,要么只反映粗差任务关联性,因此难以在不同任务中有效转让知识。为了解决这些问题,我们在本文件中提议采用适应性精细任务相关模型方法AdaFTR,用于CTR-CVR联合估算。我们的方法是以参数共享MTL结构为基础制定的,并采用基于对比性学习的新型适应性跨任务代表比对方法。举个例子,认为同一实例的跨任务表达方式是积极的,而另一个随机实例的表述则被视为负面的。此外,我们明确提出一个微小任务关联性模型,作为对比力(即,InfoNCE损失的温度系数),在实例一级。为此,我们建立了一个关联性预测网络,以便基于对比性学习的适应性测试性系统,从而以更精确的方式在纸质上进行对比性的数据对比性对比性测试。我们可以通过一个实例来测试一个比喻的系统,以测试性模型来测试一个比喻。