High-velocity dynamic actions (e.g., fling or throw) play a crucial role in our everyday interaction with deformable objects by improving our efficiency and effectively expanding our physical reach range. Yet, most prior works have tackled cloth manipulation using exclusively single-arm quasi-static actions, which requires a large number of interactions for challenging initial cloth configurations and strictly limits the maximum cloth size by the robot's reach range. In this work, we demonstrate the effectiveness of dynamic flinging actions for cloth unfolding with our proposed self-supervised learning framework, FlingBot. Our approach learns how to unfold a piece of fabric from arbitrary initial configurations using a pick, stretch, and fling primitive for a dual-arm setup from visual observations. The final system achieves over 80% coverage within 3 actions on novel cloths, can unfold cloths larger than the system's reach range, and generalizes to T-shirts despite being trained on only rectangular cloths. We also finetuned FlingBot on a real-world dual-arm robot platform, where it increased the cloth coverage over 4 times more than the quasi-static baseline did. The simplicity of FlingBot combined with its superior performance over quasi-static baselines demonstrates the effectiveness of dynamic actions for deformable object manipulation.
翻译:高速度动态动作(例如抛掷或抛掷)在我们与变形物体的日常互动中发挥着关键作用,提高了我们的效率,有效地扩大了我们的实际接触范围。然而,大多数先前的工程都利用纯粹的单臂准静态动作解决了布局操纵问题,这需要大量互动来挑战初始布局配置,并严格限制机器人接触范围的最大布面大小。在这项工作中,我们展示了与我们拟议的自我监督学习框架FlingBot一起布局动态布局的动态布局的有效性。我们的方法学会了如何利用视觉观察的提取、伸展和原始的任意初始布局来展开一块布局。最后的系统在3个新布局上实现了超过80%的覆盖,可以展示比系统接触范围大得多的布局,并且尽管我们只接受了矩形布培训,但我们还在真实世界双臂机器人平台上对FBot作了微调,它把布局的布局比准动态基底线运行得要快4倍多。