In this paper, we design, analyze the convergence properties and address the implementation aspects of AFAFed. This is a novel Asynchronous Fair Adaptive Federated learning framework for stream-oriented IoT application environments, which are featured by time-varying operating conditions, heterogeneous resource-limited devices (i.e., coworkers), non-i.i.d. local training data and unreliable communication links. The key new of AFAFed is the synergic co-design of: (i) two sets of adaptively tuned tolerance thresholds and fairness coefficients at the coworkers and central server, respectively; and, (ii) a distributed adaptive mechanism, which allows each coworker to adaptively tune own communication rate. The convergence properties of AFAFed under (possibly) non-convex loss functions is guaranteed by a set of new analytical bounds, which formally unveil the impact on the resulting AFAFed convergence rate of a number of Federated Learning (FL) parameters, like, first and second moments of the per-coworker number of consecutive model updates, data skewness, communication packet-loss probability, and maximum/minimum values of the (adaptively tuned) mixing coefficient used for model aggregation.
翻译:在本文中,我们设计、分析趋同特性并处理AFAAFed的执行方面。这是一个新的流动导向IoT应用环境的Asynconcronous Fair Freed 适应性联邦学习框架,其特点是时间变化的操作条件、不同资源限制装置(即同事)、非i.i.d.当地培训数据和不可靠的通信链接。AFAFed的关键新是协同性共同设计:(一) 同事和中央服务器分别有两套适应性调适容忍阈值和公平系数;(二) 分布式适应性机制,使每个同事能够适应性地调整自己的通信速度。(可能)非convex损失功能下AFAFAFAF的趋同特性得到一套新的分析界限的保证,这些界限正式揭示了对由此形成的FAFAFAFD若干联邦学习(FL)参数的趋同率的影响,例如连续的模型更新数、数据基宽度、通信组合组合概率、所用最大/最基本系数的混合系数。