Agentic tool use has gained traction with the rise of agentic tool calling, yet most existing work overlooks the complexity of multi-turn tool interactions. We introduce OrchDAG, a synthetic data generation pipeline that models tool execution as directed acyclic graphs (DAGs) with controllable complexity. Using this dataset, we benchmark model performance and propose a graph-based reward to enhance RLVR training. Experiments show that the dataset presents a challenging but solvable benchmark, and the proposed reward is effective when combined with GRPO-style algorithms, highlighting the importance of leveraging topological structure and data complexity in multi-turn tool use.
翻译:随着智能体工具调用的兴起,代理式工具使用已获得广泛关注,然而现有研究大多忽视了多轮工具交互的复杂性。本文提出OrchDAG——一种合成数据生成流程,它将工具执行建模为具有可控复杂度的有向无环图(DAG)。基于该数据集,我们建立了模型性能基准,并提出一种基于图的奖励机制以增强RLVR训练。实验表明,该数据集构成了一个具有挑战性但可解决的基准,且所提出的奖励机制与GRPO类算法结合时效果显著,这凸显了在多轮工具使用中利用拓扑结构与数据复杂度的重要性。