Multi-agent learning has gained increasing attention to tackle distributed machine learning scenarios under constrictions of data exchanging. However, existing multi-agent learning models usually consider data fusion under fixed and compulsory collaborative relations among agents, which is not as flexible and autonomous as human collaboration. To fill this gap, we propose a distributed multi-agent learning model inspired by human collaboration, in which the agents can autonomously detect suitable collaborators and refer to collaborators' model for better performance. To implement such adaptive collaboration, we use a collaboration graph to indicate the pairwise collaborative relation. The collaboration graph can be obtained by graph learning techniques based on model similarity between different agents. Since model similarity can not be formulated by a fixed graphical optimization, we design a graph learning network by unrolling, which can learn underlying similar features among potential collaborators. By testing on both regression and classification tasks, we validate that our proposed collaboration model can figure out accurate collaborative relationship and greatly improve agents' learning performance.
翻译:多智能体学习已经越来越受到关注,以应对数据交互受限的分布式机器学习场景的挑战。然而,现有的多智能体学习模型通常考虑在固定和强制性的协作关系下进行数据融合,这种模式不如人类协作那样灵活和自主。为了填补这一空白,我们提出了一种受人类协作启发的分布式多智能体学习模型,其中智能体可以自主检测适合的合作者并参考合作者的模型以获得更好的性能。为了实现这种自适应协作,我们使用协作图来指示成对的协作关系。协作图可以通过基于不同智能体之间的模型相似度的图形学习技术获得。由于模型相似度不能由固定的图形优化来表达,我们设计了一种通过展开学习潜在相似功能的图形学习网络。通过在回归和分类任务上进行测试,我们验证了我们提出的协作模型可以找出准确的协作关系并大大提高智能体的学习性能。