While deep learning has achieved great success on various tasks, the task-specific model training notoriously relies on a large volume of labeled data. Recently, a new training paradigm of ``pre-train, prompt, predict'' has been proposed to improve model generalization ability with limited labeled data. The main idea is that, based on a pre-trained model, the prompting function uses a template to augment input samples with indicative context and reformalizes the target task to one of the pre-training tasks. In this survey, we provide a unique review of prompting methods from the graph perspective. Graph data has served as structured knowledge repositories in various systems by explicitly modeling the interaction between entities. Compared with traditional methods, graph prompting functions could induce task-related context and apply templates with structured knowledge. The pre-trained model is then adaptively generalized for future samples. In particular, we introduce the basic concepts of graph prompt learning, organize the existing work of designing graph prompting functions, and describe their applications and challenges to a variety of machine learning problems. This survey attempts to bridge the gap between structured graphs and prompt design to facilitate future methodology development.
翻译:虽然深入学习在各种任务上取得了巨大成功,但任务特定模式培训却明显依赖大量贴标签数据。最近,提出了“培训前、迅速、预测”的新培训模式,以利用有限的标签数据改进模式的概括能力。主要想法是,根据预先培训的模式,促进功能使用模板来增加具有指示性背景的输入样本,并将目标任务重新纳入培训前任务之一。在这次调查中,我们从图表角度对快速方法进行了独特的审查。图表数据通过明确模拟实体之间的互动,成为各种系统中的结构化知识库。与传统方法相比,图表提示功能可以产生与任务相关的背景,并应用结构化知识模板。然后,预先培训的模式将适应性地适用于未来的样本。特别是,我们引入了图表快速学习的基本概念,组织设计图表提示功能的现有工作,并描述其应用和对各种机器学习问题的挑战。这次调查试图弥合结构化图表与迅速设计之间的差距,以便利未来方法的发展。</s>