In evolutionary robotics, several approaches have been shown to be capable of the joint optimisation of body-plans and controllers by either using only evolution or combining evolution and learning. When working in rich morphological spaces, it is common for offspring to have body-plans that are very different from either of their parents, which can cause difficulties with respect to inheriting a suitable controller. To address this, we propose a framework that combines an evolutionary algorithm to generate body-plans and a learning algorithm to optimise the parameters of a neural controller where the topology of this controller is created once the body-plan of each offspring body-plan is generated. The key novelty of the approach is to add an external archive for storing learned controllers that map to explicit `types' of robots (where this is defined with respect the features of the body-plan). By inheriting an appropriate controller from the archive rather than learning from a randomly initialised one, we show that both the speed and magnitude of learning increases over time when compared to an approach that starts from scratch, using three different test-beds. The framework also provides new insights into the complex interactions between evolution and learning, and the role of morphological intelligence in robot design.
翻译:在进化机器人中,通过仅仅使用进化或结合进化与学习,有几种方法证明能够共同优化机体计划和控制器。 在丰富的形态空间工作时,后代通常会拥有与父母中任何一方截然不同的身体计划,这在继承合适的控制器方面会造成困难。为了解决这个问题,我们提议了一个框架,将进化算法结合起来,以生成机体计划,并采用学习算法优化神经控制器的参数,在神经控制器的地形一旦产生每个子体计划的机构计划时,该控制器的地形就会形成。这个方法的关键新颖之处是增加一个外部档案,用于储存学到的控器,以绘制机器人“类型”的清晰图(如果这是与机体计划特征有关的定义)。 通过从档案中继承一个适当的控制器,而不是随机地学习一个主控器,我们表明,与从零开始的方法相比,学习的速度和规模会随着时间的增加,使用三个不同的测试床。这个框架还提供了对机器人演进和学习的复杂设计作用的新认识。