Recommender systems have become ubiquitous in the past years. They solve the tyranny of choice problem faced by many users, and are employed by many online businesses to drive engagement and sales. Besides other criticisms, like creating filter bubbles within social networks, recommender systems are often reproved for collecting considerable amounts of personal data. However, to personalize recommendations, personal information is fundamentally required. A recent distributed learning scheme called federated learning has made it possible to learn from personal user data without its central collection. Accordingly, we present a complete recommender system for movie recommendations, which provides privacy and thus trustworthiness on two levels: First, it is trained using federated learning and thus is, by its very nature, privacy-preserving, while still enabling individual users to benefit from global insights. And second, a novel federated learning scheme, FedQ, is employed, which not only addresses the problem of non-i.i.d. and small local datasets, but also prevents input data reconstruction attacks by aggregating client models early. To reduce the communication overhead, compression is applied, which significantly reduces the exchanged neural network updates to a fraction of their original data. We conjecture that it may also improve data privacy through its lossy quantization stage.
翻译:过去几年来,建议系统已经变得无处不在。 它们解决了许多用户面临的选择专制问题,并且被许多在线企业用来推动参与和销售。 除了其他批评,比如在社交网络中制造过滤泡沫,建议系统常常被重新推出以收集大量个人数据。然而,为了个性化建议,从根本上需要个人信息。最近分发的称为“联合学习”的学习计划使得有可能在不集中收集的情况下从个人用户数据中学习。因此,我们为电影建议提供一个完整的推荐系统,它提供隐私,从而在两个层面具有可信赖性:第一,它受到使用联合学习的培训,因此,由于其本身的性质,保护隐私,仍然使个人用户能够受益于全球洞察力。第二,采用了一个新的联合学习计划,即FedQ,它不仅解决了非i.d.d.和小的本地数据集问题,而且还通过早期汇总客户模型来防止输入数据重建攻击。为了减少通信管理,采用了压缩,它大大降低了交换的神经网络更新到原始数据阶段的零分层。我们还可以对数据进行分析,这样可以改进。</s>