Interactive reinforcement learning, where humans actively assist during an agent's learning process, has the promise to alleviate the sample complexity challenges of practical algorithms. However, the inner workings and state of the robot are typically hidden from the teacher when humans provide feedback. To create a common ground between the human and the learning robot, in this paper, we propose an Augmented Reality (AR) system that reveals the hidden state of the learning to the human users. This paper describes our system's design and implementation and concludes with a discussion on two directions for future work which we are pursuing: 1) use of our system in AI education activities at the K-12 level; and 2) development of a framework for an AR-based human-in-the-loop reinforcement learning, where the human teacher can see sensory and cognitive representations of the robot overlaid in the real world.
翻译:互动强化学习是人类在代理人学习过程中积极帮助的,它有可能减轻实际算法的抽样复杂挑战。然而,当人类提供反馈时,机器人的内部功能和状态通常被教师所隐藏。为了在人类和学习机器人之间建立共同点,我们在本文件中建议建立一个增强现实系统,向人类用户揭示学习的隐蔽状态。本文件描述了我们的系统的设计和实施,并在最后讨论了我们未来工作的两个方向:1)在K-12级的AI教育活动中使用我们的系统;和2)开发一个框架,用于基于AR的“流动中人”强化学习,让人类教师看到机器人在现实世界中的感官和认知表现。