A resource-constrained unmanned aerial vehicle (UAV) can be used as a flying LoRa gateway (GW) to move inside the target area for efficient data collection and LoRa resource management. In this work, we propose deep reinforcement learning (DRL) to optimize the energy efficiency (EE) in wireless LoRa networks composed of LoRa end devices (EDs) and a flying GW to extend the network lifetime. The trained DRL agent can efficiently allocate the spreading factors (SFs) and transmission powers (TPs) to EDs while considering the air-to-ground wireless link and the availability of SFs. In addition, we allow the flying GW to adjust its optimal policy onboard and perform online resource allocation. This is accomplished through retraining the DRL agent using reduced action space. Simulation results demonstrate that our proposed DRL-based online resource allocation scheme can achieve higher EE in LoRa networks over three benchmark schemes.
翻译:在这项工作中,我们提议深入强化学习(DRL),以优化由Lora终端装置和飞行GW组成的无线Lora网络的能效(EE),以延长网络寿命。经过培训的DRL代理可以有效地将扩散因素(SF)和传输权力(TP)分配给ED,同时考虑空对地无线链接和SF的可用性。此外,我们允许飞行GW调整其最佳机载政策并进行在线资源分配。这是通过利用减少的行动空间对DRL代理进行再培训来实现的。模拟结果表明,我们提议的DRL在线资源分配计划可以在LoRa网络上通过三个基准计划实现更高的EE。