Model-Based Reinforcement Learning (MBRL) is one category of Reinforcement Learning (RL) algorithms which can improve sampling efficiency by modeling and approximating system dynamics. It has been widely adopted in the research of robotics, autonomous driving, etc. Despite its popularity, there still lacks some sophisticated and reusable open-source frameworks to facilitate MBRL research and experiments. To fill this gap, we develop a flexible and modularized framework, Baconian, which allows researchers to easily implement a MBRL testbed by customizing or building upon our provided modules and algorithms. Our framework can free users from re-implementing popular MBRL algorithms from scratch thus greatly save users' efforts on MBRL experiments.
翻译:以模型为基础的强化学习(MBRL)是一种强化学习(RL)算法,它可以通过建模和接近系统动态来提高取样效率,在机器人、自主驾驶等研究中被广泛采用。尽管它很受欢迎,但仍然缺乏一些先进和可重复使用的开放源框架来便利MBRL的研究和实验。为了填补这一空白,我们开发了一个灵活和模块化的框架,即Baconian,它使研究人员能够通过定制或以我们提供的模块和算法为基础,方便地执行MBRL测试。我们的框架可以使用户免于重新实施流行的MBRL算法,从而大大节省了用户在MBRL实验上的努力。