Multi-party learning is an indispensable technique for improving the learning performance via integrating data from multiple parties. Unfortunately, directly integrating multi-party data would not meet the privacy preserving requirements. Therefore, Privacy-Preserving Machine Learning (PPML) becomes a key research task in multi-party learning. In this paper, we present a new PPML method based on secure multi-party interactive protocol, namely Multi-party Secure Broad Learning System (MSBLS), and derive security analysis of the method. The existing PPML methods generally cannot simultaneously meet multiple requirements such as security, accuracy, efficiency and application scope, but MSBLS achieves satisfactory results in these aspects. It uses interactive protocol and random mapping to generate the mapped features of data, and then uses efficient broad learning to train neural network classifier. This is the first privacy computing method that combines secure multi-party computing and neural network. Theoretically, this method can ensure that the accuracy of the model will not be reduced due to encryption, and the calculation speed is very fast. We verify this conclusion on three classical datasets.
翻译:多党学习是通过多方整合数据来改进学习绩效的不可或缺的技术。 不幸的是,直接整合多党数据无法满足隐私保护要求。 因此,隐私保护机器学习(PPML)成为多党学习的关键研究任务。 在本文中,我们介绍了基于安全的多党互动协议的新的PPML方法,即多党安全宽广学习系统(MSBLS),并对该方法进行安全分析。现有的PPML方法一般无法同时满足安全、准确性、效率和应用范围等多重要求,但MSBLS在这些方面取得了令人满意的结果。它使用互动协议和随机绘图来生成数据绘图特征,然后使用高效的广泛学习来培训神经网络分类。这是第一个将安全的多党计算和神经网络结合起来的隐私计算方法。理论上,这种方法可以确保模型的准确性不会因加密而降低,而计算速度非常快。 我们在三个经典数据集上核查了这一结论。