Vision-Language-Action (VLA) models trained with flow matching have demonstrated impressive capabilities on robotic manipulation tasks. However, their performance often degrades under distribution shift and on complex multi-step tasks, suggesting that the learned representations may not robustly capture task-relevant semantics. We introduce DiG-Flow, a principled framework that enhances VLA robustness through geometric regularization. Our key insight is that the distributional discrepancy between observation and action embeddings provides a meaningful geometric signal: lower transport cost indicates compatible representations, while higher cost suggests potential misalignment. DiG-Flow computes a discrepancy measure between empirical distributions of observation and action embeddings, maps it to a modulation weight via a monotone function, and applies residual updates to the observation embeddings before flow matching. Crucially, this intervention operates at the representation level without modifying the flow matching path or target vector field. We provide theoretical guarantees showing that discrepancy-guided training provably decreases the training objective, and that guided inference refinement converges with contraction. Empirically, DiG-Flow integrates into existing VLA architectures with negligible overhead and consistently improves performance, with particularly pronounced gains on complex multi-step tasks and under limited training data.
翻译:基于流匹配训练的视觉-语言-动作(VLA)模型在机器人操作任务中已展现出卓越的能力。然而,其性能在分布偏移和复杂多步任务下常出现下降,这表明学习到的表征可能未能鲁棒地捕获任务相关的语义。我们提出了DiG-Flow,一个通过几何正则化增强VLA鲁棒性的原理性框架。我们的核心洞见是:观测与动作嵌入之间的分布差异提供了一个有意义的几何信号——较低的传输成本表示表征兼容,而较高的成本则暗示潜在的对齐偏差。DiG-Flow计算观测与动作嵌入经验分布间的差异度量,通过单调函数将其映射为调制权重,并在流匹配前对观测嵌入应用残差更新。关键在于,这种干预在表征层面操作,无需修改流匹配路径或目标向量场。我们提供了理论保证,表明差异引导的训练可证明地降低训练目标,且引导的推理细化过程以收缩方式收敛。实证上,DiG-Flow能以可忽略的开销集成到现有VLA架构中,并持续提升性能,尤其在复杂多步任务和有限训练数据条件下,其增益尤为显著。