We propose SwiftAgg, a novel secure aggregation protocol for federated learning systems, where a central server aggregates local models of $N$ distributed users, each of size $L$, trained on their local data, in a privacy-preserving manner. Compared with state-of-the-art secure aggregation protocols, SwiftAgg significantly reduces the communication overheads without any compromise on security. Specifically, in presence of at most $D$ dropout users, SwiftAgg achieves a users-to-server communication load of $(T+1)L$ and a users-to-users communication load of up to $(N-1)(T+D+1)L$, with a worst-case information-theoretic security guarantee, against any subset of up to $T$ semi-honest users who may also collude with the curious server. The key idea of SwiftAgg is to partition the users into groups of size $D+T+1$, then in the first phase, secret sharing and aggregation of the individual models are performed within each group, and then in the second phase, model aggregation is performed on $D+T+1$ sequences of users across the groups. If a user in a sequence drops out in the second phase, the rest of the sequence remain silent. This design allows only a subset of users to communicate with each other, and only the users in a single group to directly communicate with the server, eliminating the requirements of 1) all-to-all communication network across users; and 2) all users communicating with the server, for other secure aggregation protocols. This helps to substantially slash the communication costs of the system.
翻译:我们提出SwiftAgg,这是联邦学习系统新颖的SwiftAgg安全聚合协议,其中中央服务器以保密方式,以保存隐私的方式,对本地数据进行当地数据培训。与最先进的安全聚合协议相比,SwiftAgg大大降低了通信管理费用,而没有任何安全妥协。具体地说,SwiftAgg在最多为D美元的辍学用户在场的情况下,实现了用户对服务器的通信负荷(T+1)L$,用户对用户的通信负荷高达$(N-1)(T+D+1)L$,用户对用户的通信负荷高达$(N-1)(T+D+1)L$,对用户的本地数据进行了最差的信息理论安全保障。与任何可能与好奇服务器串通的半诚实用户子集相比,SwiftAgg的关键思想是将用户分成一个规模为$+T+1美元的用户组,然后在第一阶段,每个用户之间的秘密共享和集合,然后在第二个阶段里,这个服务器的用户的用户之间的通信顺序,如果在设计程序上进行,模型的顺序上保持,每个用户之间的连接,每个用户的顺序。