In this paper, we present Context-Adaptive PARRoT (CA-PARRoT) as an extension of our previous work Predictive Ad-hoc Routing fueled by Reinforcement learning and Trajectory knowledge (PARRoT). Short-term effects, as occurring in urban surroundings, have shown to have a negative impact on the Reinforcement Learning (RL)-based routing process. Therefore, we add a timer-based compensation mechanism to the update process and introduce a hybrid Machine Learning (ML) approach to classify Radio Environment Prototypes (REPs) with a dedicated ML component and enable the protocol for autonomous context adaption. The performance of the novel protocol is evaluated in comprehensive network simulations considering different REPs and is compared to well-known established routing protocols for Mobile Ad-hoc Networks (MANETs). The results show, that CA-PARRoT is capable to compensate the challenges confronted with in different REPs and to improve its Key Performance Indicators (KPIs) up to 23% compared to PARRoT, and outperform established routing protocols by up to 50 %.
翻译:在本文中,我们介绍了基于环境的适应性PARROT(CA-PARROT),作为我们先前工作的一个延伸,通过强化学习和轨迹知识(PARROT)推动的预测性自动运行。在城市周围发生的短期效应表明,对基于强化学习(RL)的路线设定过程产生了负面影响。因此,我们在更新过程中增加了基于时间的补偿机制,并引入了混合机器学习(ML)方法,将无线电环境原型(REP)分类为专门的 ML 组件,并启用了自动环境适应协议。新书的性能在综合网络模拟中进行了评价,考虑到不同的区域环境协议,并与众所周知的移动Adhoc网络(MANETs)既定路线设置协议相比较。结果显示,CA-PARROT能够补偿不同区域建议中遇到的挑战,并将其主要业绩指标提高到23%,而PARRoT则比主要业绩指标高出50%。