Recently, mobile robots have become important tools in various industries, especially in logistics. Deep reinforcement learning emerged as an alternative planning method to replace overly conservative approaches and promises more efficient and flexible navigation. However, deep reinforcement learning approaches are not suitable for long-range navigation due to their proneness to local minima and lack of long term memory, which hinders its widespread integration into industrial applications of mobile robotics. In this paper, we propose a navigation system incorporating deep-reinforcement-learning-based local planners into conventional navigation stacks for long-range navigation. Therefore, a framework for training and testing the deep reinforcement learning algorithms along with classic approaches is presented. We evaluated our deep-reinforcement-learning-enhanced navigation system against various conventional planners and found that our system outperforms them in terms of safety, efficiency and robustness.
翻译:最近,移动机器人已成为各种行业,特别是物流行业的重要工具。深层强化学习作为一种替代规划方法,取代过于保守的方法,并承诺以更高效、更灵活的导航方式。然而,深层强化学习方法由于容易发生局部微型和缺乏长期记忆,妨碍了其广泛融入移动机器人的工业应用,因此不适合远程导航,在本文件中,我们提议建立一个导航系统,将深层强化学习的当地规划者纳入远程导航常规导航堆叠。因此,提出了培训和测试深层强化学习算法的框架,同时提出了经典方法。我们评估了我们针对各种常规规划者的深层强化学习强化导航系统,发现我们的系统在安全、效率和稳健性方面优于这些系统。