We present a node-based storytelling system for multimodal content generation. The system represents stories as graphs of nodes that can be expanded, edited, and iteratively refined through direct user edits and natural-language prompts. Each node can integrate text, images, audio, and video, allowing creators to compose multimodal narratives. A task selection agent routes between specialized generative tasks that handle story generation, node structure reasoning, node diagram formatting, and context generation. The interface supports targeted editing of individual nodes, automatic branching for parallel storylines, and node-based iterative refinement. Our results demonstrate that node-based editing supports control over narrative structure and iterative generation of text, images, audio, and video. We report quantitative outcomes on automatic story outline generation and qualitative observations of editing workflows. Finally, we discuss current limitations such as scalability to longer narratives and consistency across multiple nodes, and outline future work toward human-in-the-loop and user-centered creative AI tools.
翻译：我们提出了一种基于节点的多模态内容生成叙事系统。该系统将故事表示为节点图，可通过用户直接编辑和自然语言提示进行扩展、修改与迭代优化。每个节点可整合文本、图像、音频和视频，使创作者能够构建多模态叙事。任务选择代理在专用生成任务间进行路由，包括故事生成、节点结构推理、节点图格式化及上下文生成。该界面支持针对单个节点的定向编辑、并行故事线的自动分支以及基于节点的迭代优化。实验结果表明，基于节点的编辑方式能够实现对叙事结构的控制，并支持文本、图像、音频和视频的迭代生成。我们报告了自动故事大纲生成的量化结果，并对编辑工作流程进行了定性观察。最后，我们讨论了当前局限性，例如对长篇叙事的可扩展性及多节点间的一致性，并展望了未来面向人在回路和以用户为中心的创意人工智能工具的研究方向。
微信扫码咨询专知VIP会员