In recommender systems, the collected data always contains various biases and leads to the challenge of accurate predictions. To address selection bias and confounding bias, the doubly robust (DR) method and its variants show superior performance due to the double robustness property and smaller bias under inaccurate propensity and error imputation models. However, we theoretically show that the variance of the error imputation-based (EIB) method is much smaller than that of DR, although EIB may suffer from a much larger bias. In this paper, we propose a doubly robust targeted learning method that effectively combines the small-bias property of DR and the small-variance property of EIB, by leveraging the targeted maximum likelihood estimation technique. Theoretical analysis shows that the proposed targeted learning is effective in reducing the variance of DR while maintaining double robustness. To further reduce the bias and variance during the training process, we propose a novel collaborative targeted learning approach that decomposes imputed errors into parametric and nonparametric parts and updates them collaboratively, resulting in more accurate predictions. Both theoretical analysis and experiments demonstrate the superiority of the proposed methods compared with existing debiasing methods.
翻译:在推荐人系统中,所收集的数据总是包含各种偏差,并导致准确预测的挑战。为了解决选择偏差和混淆偏差,双强强(DR)方法及其变式显示出由于双重稳健性属性和不准确倾向和误算模型下的较小偏差而表现出优异性。然而,我们理论上表明,基于误算(EIB)方法的差异远远小于基于DR的偏差,尽管EIB可能遭受大得多的偏差。在本文中,我们提出一种双倍有力的有针对性的学习方法,通过利用有针对性的最大可能性估计技术,有效地将DR的小偏差属性与EIB的微变异性属性结合起来。理论分析表明,拟议的定向学习在减少DR差异的同时保持双稳健性能有效。为进一步减少培训过程中的偏差和差异,我们建议一种新型的协作性定向学习方法,将误差分解成参数和非对称部分,并进行更新,从而更精确地预测。理论分析和实验都表明拟议方法优于现有退化方法。