We introduce ObSynth, an interactive system leveraging the domain knowledge embedded in large language models (LLMs) to help users design object models from high level natural language prompts. This is an example of specification reification, the process of taking a high-level, potentially vague specification and reifying it into a more concrete form. We evaluate ObSynth via a user study, leading to three key findings: first, object models designed using ObSynth are more detailed, showing that it often synthesizes fields users might have otherwise omitted. Second, a majority of objects, methods, and fields generated by ObSynth are kept by the user in the final object model, highlighting the quality of generated components. Third, ObSynth altered the workflow of participants: they focus on checking that synthesized components were correct rather than generating them from scratch, though ObSynth did not reduce the time participants took to generate object models.
翻译:我们引入了ObSynth,这是一个利用大型语言模型(LLMs)嵌入的域知识的互动系统,帮助用户设计来自高水平自然语言提示的物体模型。这是一个规格再化过程的例子,即采用高层次的、可能模糊的规格并将其重新整合到更具体的形式。我们通过用户研究对ObSynth进行了评估,得出三个主要结论:首先,使用ObSynth设计的物体模型更为详细,表明它通常会合成字段用户。第二,ObSynth生成的大多数物体、方法和字段都由最终对象模型的用户保存,突出生成部件的质量。第三,ObSynth改变了参与者的工作流程:他们侧重于检查合成部件是否正确,而不是从零开始生成,尽管ObSynth没有减少参与者生成物体模型的时间。