Procedural planning aims to implement complex high-level goals by decomposition into sequential simpler low-level steps. Although procedural planning is a basic skill set for humans in daily life, it remains a challenge for large language models (LLMs) that lack a deep understanding of the cause-effect relations in procedures. Previous methods require manual exemplars to acquire procedural planning knowledge from LLMs in the zero-shot setting. However, such elicited pre-trained knowledge in LLMs induces spurious correlations between goals and steps, which impair the model generalization to unseen tasks. In contrast, this paper proposes a neuro-symbolic procedural PLANner (PLAN) that elicits procedural planning knowledge from the LLMs with commonsense-infused prompting. To mitigate spurious goal-step correlations, we use symbolic program executors on the latent procedural representations to formalize prompts from commonsense knowledge bases as a causal intervention toward the Structural Causal Model. Both automatic and human evaluations on WikiHow and RobotHow show the superiority of PLAN on procedural planning without further training or manual exemplars.
翻译:程序性规划的目的是通过分解成顺序更简单的低层次步骤,实现复杂的高层次目标。虽然程序规划是人类日常生活中的基本技能,但对在程序上缺乏深刻理解因果关系的大型语言模型(LLMs)来说仍然是一项挑战。以前的方法要求人工示范者在零发环境中从LLMs获得程序规划知识。然而,这种在LLMs中预先获得的知识在目标和步骤之间产生虚假的关联,从而妨碍将模型概括为看不见的任务。与此相反,本文件提议建立一个神经-同步程序规划员(PLAN),从具有常识且迅速传播的LLLMs中获取程序规划知识。为了减轻不切实际的目标步关联,我们在潜在的程序表述上使用象征性的方案执行者,将普通知识基础的提示正规化,作为对结构卡萨勒模型的因果关系干预。WikiHiHow和RobotHow的自动和人为评价都显示PLPEP在程序规划上的优越性,而没有进一步培训或人工排除器。