This paper surveys the field of transfer learning in the problem setting of Reinforcement Learning (RL). RL has been the key solution to sequential decision-making problems. Along with the fast advance of RL in various domains. including robotics and game-playing, transfer learning arises as an important technique to assist RL by leveraging and transferring external expertise to boost the learning process. In this survey, we review the central issues of transfer learning in the RL domain, providing a systematic categorization of its state-of-the-art techniques. We analyze their goals, methodologies, applications, and the RL frameworks under which these transfer learning techniques would be approachable. We discuss the relationship between transfer learning and other relevant topics from an RL perspective and also explore the potential challenges as well as future development directions for transfer learning in RL.
翻译:本文调查了加强学习问题设置中的转让学习领域。RL是连续决策问题的关键解决办法。除了在包括机器人和游戏游戏在内的各个领域迅速推进RL之外,转让学习还作为一种重要技术,通过利用和转让外部专门知识协助RL促进学习过程。在本次调查中,我们审查了RL领域转让学习的中心问题,对其最新技术进行了系统分类。我们分析了这些转让学习技术的目标、方法、应用和框架。我们从RL的角度讨论了转让学习和其他相关专题之间的关系,还探讨了转让学习的潜在挑战以及今后在RL进行转让学习的发展方向。