Radio access network (RAN) slicing allows the division of the network into several logical networks tailored to different and varying service requirements in a sustainable way. It is thereby considered a key enabler of 5G and next generation networks. However, determining optimal strategies for RAN slicing remains a challenging issue. Using machine learning algorithms to address such a difficult problem is promising. However, due to the large differences imposed by RAN deployments and the disparity of their required services it is difficult to utilize the same slicing model across all the covered areas. Moreover, the data collected by each mobile virtual network operator (MVNO) in different areas is mostly limited and rarely shared among operators. Federated learning presents new opportunities for MVNOs to benefit from distributed training. In this paper, we propose a federated deep reinforcement learning (FDRL) approach to train bandwidth allocation models among MVNOs based on their interactions with their users. We evaluate the proposed approach through extensive simulations to show the importance of such collaboration in building efficient network slicing models.
翻译:无线电接入网络(RAN)切片使网络能够以可持续的方式分为若干符合不同和不同服务要求的逻辑网络,因此被视为5G和下一代网络的关键推动者,然而,确定RAN切片的最佳战略仍是一个具有挑战性的问题。利用机器学习算法解决如此困难的问题是很有希望的。然而,由于RAN部署造成的巨大差异及其所需服务的差异,很难在所有覆盖地区使用同样的切片模式。此外,不同地区每个移动虚拟网络运营商收集的数据大多有限,而且很少在运营商之间共享。联邦学习为MVNO提供从分布式培训中受益的新机会。在本文件中,我们提议采用一种联合深度强化学习(FDRL)方法,根据MVNO与用户的互动情况,在他们之间培训带宽分配模式。我们通过广泛的模拟评估拟议方法,以显示在建立高效网络切片模式方面进行此类合作的重要性。