Multi-agent learning has gained increasing attention to tackle distributed machine learning scenarios under constrictions of data exchanging. However, existing multi-agent learning models usually consider data fusion under fixed and compulsory collaborative relations among agents, which is not as flexible and autonomous as human collaboration. To fill this gap, we propose a distributed multi-agent learning model inspired by human collaboration, in which the agents can autonomously detect suitable collaborators and refer to collaborators' model for better performance. To implement such adaptive collaboration, we use a collaboration graph to indicate the pairwise collaborative relation. The collaboration graph can be obtained by graph learning techniques based on model similarity between different agents. Since model similarity can not be formulated by a fixed graphical optimization, we design a graph learning network by unrolling, which can learn underlying similar features among potential collaborators. By testing on both regression and classification tasks, we validate that our proposed collaboration model can figure out accurate collaborative relationship and greatly improve agents' learning performance.
翻译:多试剂学习日益受到重视,在数据交换的收缩下处理分散的机器学习情景;然而,现有的多试剂学习模式通常在代理人之间固定和强制性合作关系下考虑数据融合,这种合作关系不像人类协作那样灵活和自主。为填补这一空白,我们提议了一个分散的多试剂学习模式,由人类协作启发,使代理人能够自主地检测适当的合作者,并参照合作者模式,以取得更好的业绩。为了实施这种适应性协作,我们使用一个合作图表来显示对称协作关系。合作图表可以通过基于不同代理人之间模式相似性的图表学习技术获得。由于模型相似性不能通过固定的图形优化来形成,我们通过解动来设计一个图表学习网络,从而可以了解潜在合作者之间类似特征的基础。通过测试回归和分类任务,我们验证我们提出的合作模式能够找出准确的合作关系,并大大改进代理人的学习表现。