In the Real-Time Bidding (RTB), advertisers are increasingly relying on bid optimization to gain more conversions (i.e trade or arrival). Currently, the efficiency of bid optimization is still challenged by the (1) sparse feedback, (2) the budget management separated from the optimization, and (3) absence of bidding environment modeling. The conversion feedback is delayed and sparse, yet most methods rely on dense input (impression or click). Furthermore, most approaches are implemented in two stages: optimum formulation and budget management, but the separation always degrades performance. Meanwhile, absence of bidding environment modeling, model-free controllers are commonly utilized, which perform poorly on sparse feedback and lead to control instability. We address these challenges and provide the Multi-Constraints with Merging Features (MCMF) framework. It collects various bidding statuses as merging features to promise performance on the sparse and delayed feedback. A cost function is formulated as dynamic optimum solution with budget management, the optimization and budget management are not separated. According to the cost function, the approximated gradients based on the Hebbian Learning Rule are capable of updating the MCMF, even without modeling of the bidding environment. Our technique performs the best in the open dataset and provides stable budget management even in extreme sparsity. The MCMF is applied in our real RTB production and we get 2.69% more conversions with 2.46% fewer expenditures.
翻译:在实时投标(RTB)中,广告商越来越依赖投标优化,以获得更多的转换(即交易或到货),目前,投标优化的效率仍然受到以下挑战:(1) 反馈稀少,(2) 预算管理与优化分开,(3) 没有投标环境模型; 转换反馈延迟和稀少,但大多数方法依赖密集投入(压缩或点击),此外,大多数方法都分两个阶段实施:优化制定和预算管理,但分离总是降低业绩。与此同时,缺乏投标环境模型,通常使用无型控制器,这种模型在微小反馈方面表现不佳,导致控制不稳定。我们应对这些挑战,提供多层控制器,采用合并功能,与优化和延迟反馈相结合,但大多数方法依赖密集投入(压缩或点击)。此外,大多数方法都分两个阶段实施:优化和预算管理,但分离总是降低业绩。同时,根据赫比亚学习规则的粗略梯度,这些模型在微反馈方面表现不佳,导致控制不稳定。我们处理这些挑战,提供多层合并功能,提供多功能(MFMF)框架框架框架框架框架框架。它收集了各种合并功能,以许诺,保证业绩,优化和优化管理。我们采用最佳技术,在开放的预算编制中采用最佳预算。