Aerial base stations (ABSs) allow smart farms to offload processing responsibility of complex tasks from internet of things (IoT) devices to ABSs. IoT devices have limited energy and computing resources, thus it is required to provide an advanced solution for a system that requires the support of ABSs. This paper introduces a novel multi-actor-based risk-sensitive reinforcement learning approach for ABS task scheduling for smart agriculture. The problem is defined as task offloading with a strict condition on completing the IoT tasks before their deadlines. Moreover, the algorithm must also consider the limited energy capacity of the ABSs. The results show that our proposed approach outperforms several heuristics and the classic Q-Learning approach. Furthermore, we provide a mixed integer linear programming solution to determine a lower bound on the performance, and clarify the gap between our risk-sensitive solution and the optimal solution, as well. The comparison proves our extensive simulation results demonstrate that our method is a promising approach for providing a guaranteed task processing services for the IoT tasks in a smart farm, while increasing the hovering time of the ABSs in this farm.
翻译:空基站(ABS)使智能农场能够卸载从互联网上的东西(IoT)装置到ABS设备等复杂任务的责任。 IoT装置的能量和计算资源有限,因此需要为需要ABS支持的系统提供先进的解决方案。本文为ABS智能农业任务时间安排引入了一种新的基于风险的多行为者强化学习方法。问题被定义为在完成IoT任务的严格条件下卸载任务。此外,算法还必须考虑到ABS的有限能量能力。结果显示,我们拟议的方法优于若干超常和典型的Q-学习方法。此外,我们提供了一个混合整形线性编程解决方案,以确定对性能的较低约束,并澄清我们的风险敏感解决方案与最佳解决方案之间的差距。比较证明,我们的广泛模拟结果证明,我们的方法对于在智能农场为IoT任务提供有保障的任务处理服务是一种很有希望的方法,同时增加了ABS在农场的悬浮时间。