Blockchain has widely been adopted to design accountable federated learning frameworks; however, the existing frameworks do not scale for distributed model training over multiple independent blockchain networks. For storing the pre-trained models over blockchain, current approaches primarily embed a model using its structural properties that are neither scalable for cross-chain exchange nor suitable for cross-chain verification. This paper proposes an architectural framework for cross-chain verifiable model training using federated learning, called Proof of Federated Training (PoFT), the first of its kind that enables a federated training procedure span across the clients over multiple blockchain networks. Instead of structural embedding, PoFT uses model parameters to embed the model over a blockchain and then applies a verifiable model exchange between two blockchain networks for cross-network model training. We implement and test PoFT over a large-scale setup using Amazon EC2 instances and observe that cross-chain training can significantly boosts up the model efficacy. In contrast, PoFT incurs marginal overhead for inter-chain model exchanges.
翻译:已经广泛采用链条来设计负责任的联合学习框架;然而,现有框架并没有在多个独立连锁网中推广分布式培训模式;在将预先培训的模型储存在块链上时,目前的做法主要是嵌入一个模型,其结构特性既不能用于跨链交换,也不适合跨链核查。本文提出一个跨链可核实模式培训的建筑框架,它利用了联合学习,称为“联邦培训证明”,这是第一个能够让客户在多个连锁网中开展联合培训程序的框架。相比之下,PoFT使用结构嵌入式参数将模型嵌入一个块链,然后将两个块链网之间的可核查模式交换用于跨网络模式培训。我们利用亚马逊EC2实例实施并测试大型设置的PoFT,并观察到跨链培训能够大大提升模型的功效。相比之下,PoFT为跨链模式交流带来边际间接成本。