The quantum machine learning (QML) paradigms and their synergies with network slicing can be envisioned to be a disruptive technology on the cusp of entering to era of sixth-generation (6G), where the mobile communication systems are underpinned in the form of advanced tenancy-based digital use-cases to meet different service requirements. To overcome the challenges of massive slices such as handling the increased dynamism, heterogeneity, amount of data, extended training time, and variety of security levels for slice instances, the power of quantum computing pursuing a distributed computation and learning can be deemed as a promising prerequisite. In this intent, we propose a cloud-native federated learning framework based on quantum deep reinforcement learning (QDRL) where distributed decision agents deployed as micro-services at the edge and cloud through Kubernetes infrastructure then are connected dynamically to the radio access network (RAN). Specifically, the decision agents leverage the remold of classical deep reinforcement learning (DRL) algorithm into variational quantum circuits (VQCs) to obtain the optimal cooperative control on slice resources. The initial numerical results show that the proposed federated QDRL (FQDRL) scheme provides comparable performance than benchmark solutions and reveals the quantum advantage in parameter reduction. To the best of our knowledge, this is the first exploratory study considering an FQDRL approach for 6G communication network.
翻译:量子机器学习(QML)模式及其与网络切片的协同作用可被设想为在进入第六代(6G)时代的末端的破坏性技术,在这一阶段,移动通信系统以先进的基于租赁的数码使用案例的形式得到支撑,以满足不同的服务需求;为了克服大规模切片的挑战,例如处理增加的活力、异质性、数据数量、延长培训时间和切片安全等级的多样性,可视量量量计算进行分布式计算和学习的能力为极佳的先决条件。为此,我们提议基于量子深强化学习(QDRL)的云化联合学习框架,通过Kubernetes基础设施作为边缘和云层的微型服务进行分配,然后动态地与无线电接入网络(RAN)连接。具体地说,决策人员利用传统深度强化学习算法的重模范,将其转化为对切片资源的最佳合作控制。我们最初的数字结果显示,拟议FDRQQ的实验室降低率模型是我们用于降低水平的实验室基准性研究。