The knowledge graph (KG) is an essential form of knowledge representation that has grown in prominence in recent years. Because it concentrates on nominal entities and their relationships, traditional knowledge graphs are static and encyclopedic in nature. On this basis, event knowledge graph (Event KG) models the temporal and spatial dynamics by text processing to facilitate downstream applications, such as question-answering, recommendation and intelligent search. Existing KG research, on the other hand, mostly focuses on text processing and static facts, ignoring the vast quantity of dynamic behavioral information included in photos, movies, and pre-trained neural networks. In addition, no effort has been done to include behavioral intelligence information into the knowledge graph for deep reinforcement learning (DRL) and robot learning. In this paper, we propose a novel dynamic knowledge and skill graph (KSG), and then we develop a basic and specific KSG based on CN-DBpedia. The nodes are divided into entity and attribute nodes, with entity nodes containing the agent, environment, and skill (DRL policy or policy representation), and attribute nodes containing the entity description, pre-train network, and offline dataset. KSG can search for different agents' skills in various environments and provide transferable information for acquiring new skills. This is the first study that we are aware of that looks into dynamic KSG for skill retrieval and learning. Extensive experimental results on new skill learning show that KSG boosts new skill learning efficiency.
翻译:知识图(KG)是近年来日益突出的一种基本的知识代表形式,因为它集中在名义实体及其关系上,传统知识图是静态和百科全书性质的。在此基础上,事件知识图(Event KG)通过文本处理来模拟时间和空间动态,以便利下游应用,例如问答、建议和智能搜索。现有的KG研究主要侧重于文本处理和静态事实,忽视了照片、电影和预先培训的神经网络中包含的大量动态行为信息。此外,没有努力将行为情报信息纳入深入强化学习(DRL)和机器人学习的知识图中。在这个文件中,我们提出了一个全新的动态知识和技能图(KSG),然后我们根据NC-DBpedia开发了一个基本和具体的KSG。节点分为实体和属性节点,而实体节点包含代理、环境、环境和技能(DRL政策或政策代表),以及包含实体描述、预动智能智能信息信息节点(DRL政策代表),也没有努力将行为智能信息信息信息信息信息信息纳入KSG的高级学习环境中。我们首先可以了解KSG的学习技巧和离轨技能。