Deformable linear objects (e.g., cables, ropes, and threads) commonly appear in our everyday lives. However, perception of these objects and the study of physical interaction with them is still a growing area. There have already been successful methods to model and track deformable linear objects. However, the number of methods that can automatically extract the initial conditions in non-trivial situations for these methods has been limited, and they have been introduced to the community only recently. On the other hand, while physical interaction with these objects has been done with ground manipulators, there have not been any studies on physical interaction and manipulation of the deformable linear object with aerial robots. This workshop describes our recent work on detecting deformable linear objects, which uses the segmentation output of the existing methods to provide the initialization required by the tracking methods automatically. It works with crossings and can fill the gaps and occlusions in the segmentation and output the model desirable for physical interaction and simulation. Then we present our work on using the method for tasks such as routing and manipulation with the ground and aerial robots. We discuss our feasibility analysis on extending the physical interaction with these objects to aerial manipulation applications.
翻译:可变形线性对象(例如电缆、绳索和线)在我们的日常生活中经常出现。然而,对这些对象的感知和与它们的物理相互作用的研究仍然是一个不断发展的领域。已经有成功的方法来建模和跟踪可变形线性对象。然而,在非平凡情况下,这些方法自动提取初始条件的数量一直很有限,并且这些方法最近才向社区介绍。另一方面,虽然地面操作器已经进行了与这些对象的物理交互,但还没有关于使用空中机器人对可变形线性对象进行物理交互和操纵的研究。本研讨会描述了我们最近在检测可变形线性对象方面的工作,该方法使用现有方法的分割输出自动提供跟踪方法所需的初始条件。它适用于交叉点,可以填充分割中的空隙和遮挡,并输出可用于物理相互作用和仿真的模型。然后,我们介绍了我们如何使用该方法在地面和空中机器人任务中进行路径规划和操作。我们讨论了将与这些对象的物理交互扩展到空中操作应用的可行性分析。