Mobile Edge Learning (MEL) is a collaborative learning paradigm that features distributed training of Machine Learning (ML) models over edge devices (e.g., IoT devices). In MEL, possible coexistence of multiple learning tasks with different datasets may arise. The heterogeneity in edge devices' capabilities will require the joint optimization of the learners-orchestrator association and task allocation. To this end, we aim to develop an energy-efficient framework for learners-orchestrator association and learning task allocation, in which each orchestrator gets associated with a group of learners with the same learning task based on their communication channel qualities and computational resources, and allocate the tasks accordingly. Therein, a multi objective optimization problem is formulated to minimize the total energy consumption and maximize the learning tasks' accuracy. However, solving such optimization problem requires centralization and the presence of the whole environment information at a single entity, which becomes impractical in large-scale systems. To reduce the solution complexity and to enable solution decentralization, we propose lightweight heuristic algorithms that can achieve near-optimal performance and facilitate the trade-offs between energy consumption, accuracy, and solution complexity. Simulation results show that the proposed approaches reduce the energy consumption significantly while executing multiple learning tasks compared to recent state-of-the-art methods.
翻译:移动边缘学习(MEL)是一个合作学习模式,其特点是对机器学习模式进行分布式培训,使其超越边缘设备(例如IoT装置)。在MEL中,可能出现多种学习任务与不同数据集并存的情况。边缘设备能力的异质性将要求学习者-主机协会和任务分配的共同优化。为此,我们的目标是为学习者-主机协会和学习任务分配制定一个节能框架,每个管弦师根据通信频道质量和计算资源与一组具有相同学习任务的学习任务相联系,并据此分配任务。在MEL中,可能出现一个多目标优化问题,以尽量减少能源消耗总量,最大限度地提高学习任务的准确性。然而,解决这种优化问题需要集中化,整个环境信息存在于一个单一的实体,而这在大型系统中变得不切实际。为了降低解决方案的复杂性,并且能够实现解决方案的分散,我们建议轻量的超额超额算法,能够实现接近最佳的绩效,并便利能源消费、准确性能和解决方案之间的交易,同时显著地显示与最新学习方法相比的能源消耗、精度和解决方案的复杂性。