We consider the problem of of multi-flow transmission in wireless networks, where data signals from different flows can interfere with each other due to mutual interference between links along their routes, resulting in reduced link capacities. The objective is to develop a multi-flow transmission strategy that routes flows across the wireless interference network to maximize the network utility. However, obtaining an optimal solution is computationally expensive due to the large state and action spaces involved. To tackle this challenge, we introduce a novel algorithm called Dual-stage Interference-Aware Multi-flow Optimization of Network Data-signals (DIAMOND). The design of DIAMOND allows for a hybrid centralized-distributed implementation, which is a characteristic of 5G and beyond technologies with centralized unit deployments. A centralized stage computes the multi-flow transmission strategy using a novel design of graph neural network (GNN) reinforcement learning (RL) routing agent. Then, a distributed stage improves the performance based on a novel design of distributed learning updates. We provide a theoretical analysis of DIAMOND and prove that it converges to the optimal multi-flow transmission strategy as time increases. We also present extensive simulation results over various network topologies (random deployment, NSFNET, GEANT2), demonstrating the superior performance of DIAMOND compared to existing methods.
翻译:我们考虑无线网络中的多流传输问题。不同流中的数据信号可能会由于它们经过的路线上的链路之间的相互干扰而互相干扰。这将导致链路容量的降低。目标是开发一种多流传输策略,将流路由到无线干扰网络中,以最大化网络效用。然而,由于涉及到大量的状态和操作空间,获得最优解是计算上昂贵的。为了解决这个问题,我们介绍了一种名为“ DIAMOND”的新算法,即网络数据信号的干扰感知多流优化的双阶段算法。DIAMOND的设计允许集中-分布式实现的混合方式,这是5G及以上技术的特点。其中,集中式阶段使用一种新奇的图神经网络强化学习路由代理计算多流传输策略。然后,分布式阶段基于一种新奇的分布式学习更新方案来改善性能。我们提供了DIAMOND的理论分析,并证明随着时间的增加,DIAMOND会收敛于最优的多流传输策略。我们还展示了针对各种网络拓扑结构(随机部署,NSFNET,GEANT2)的广泛模拟结果,证明了DIAMOND与现有方法相比的卓越性能。