Recently, models have been shown to predict the effects of unexpected situations, e.g., would cloudy skies help or hinder plant growth? Given a context, the goal of such situational reasoning is to elicit the consequences of a new situation (st) that arises in that context. We propose a method to iteratively build a graph of relevant consequences explicitly in a structured situational graph (st-graph) using natural language queries over a finetuned language model (M). Across multiple domains, CURIE generates st-graphs that humans find relevant and meaningful in eliciting the consequences of a new situation. We show that st-graphs generated by CURIE improve a situational reasoning end task (WIQA-QA) by 3 points on accuracy by simply augmenting their input with our generated situational graphs, especially for a hard subset that requires background knowledge and multi-hop reasoning.
翻译:最近,一些模型被证明可以预测意外情况的影响,例如云层天空会帮助或阻碍植物生长?在某种背景下,这种情况推理的目的是引出在这一背景下出现的新情况的后果。我们建议了一种方法,用一种精细的语言模型(M)的自然语言查询,在一个结构化的情况图(st-graph)中,用一种结构化的情况图(st-graph)来反复绘制一个有关后果的图表。在多个领域,CURIE生成了人类认为在引出新情况的后果方面相关和有意义的标准图。我们表明,CURIE生成的简略图用我们生成的情况图(WIQA-QA)的精度增加了3个点的精确度,即简单地用我们生成的情况图增加它们的投入,特别是对于需要背景知识和多动脉推的硬子。