In several network problems the optimum behavior of the agents (i.e., the nodes of the network) is not known before deployment. Furthermore, the agents might be required to adapt, i.e. change their behavior based on the environment conditions. In these scenarios, offline optimization is usually costly and inefficient, while online methods might be more suitable. In this work, we use a distributed Embodied Evolution approach to optimize spatially distributed, locally interacting agents by allowing them to exchange their behavior parameters and learn from each other to adapt to a certain task within a given environment. Our results on several test scenarios show that the local exchange of information, performed by means of crossover of behavior parameters with neighbors, allows the network to conduct the optimization process more efficiently than the cases where local interactions are not allowed, even when there are large differences on the optimal behavior parameters within each agent's neighborhood.
翻译:在几个网络中,代理商(即网络的节点)的最佳行为在部署之前并不为人所知。 此外,代理商可能需要适应,即根据环境条件改变他们的行为。在这些情景中,离线优化通常成本高、效率低,而在线方法可能更合适。在这项工作中,我们使用分布式的 Embodied Evolution 方法优化空间分布,当地互动代理商允许他们交换行为参数并相互学习以适应特定环境中的某一任务。我们对几个测试情景的结果表明,通过与邻居交叉行为参数的方式进行的地方信息交流,使得网络比不允许当地互动的情况更高效地进行优化进程,即使每个代理商所在区域的最佳行为参数存在很大差异。