Deformable linear objects (e.g., cables, ropes, and threads) commonly appear in our everyday lives. However, perception of these objects and the study of physical interaction with them is still a growing area. There have already been successful methods to model and track deformable linear objects. However, the number of methods that can automatically extract the initial conditions in non-trivial situations for these methods has been limited, and they have been introduced to the community only recently. On the other hand, while physical interaction with these objects has been done with ground manipulators, there have not been any studies on physical interaction and manipulation of the deformable linear object with aerial robots. This workshop describes our recent work on detecting deformable linear objects, which uses the segmentation output of the existing methods to provide the initialization required by the tracking methods automatically. It works with crossings and can fill the gaps and occlusions in the segmentation and output the model desirable for physical interaction and simulation. Then we present our work on using the method for tasks such as routing and manipulation with the ground and aerial robots. We discuss our feasibility analysis on extending the physical interaction with these objects to aerial manipulation applications.
翻译:我们日常生活中通常会看到变形线性物体(例如电缆、绳索和线条),但对这些物体的认知和对物理互动的研究仍是一个日益扩大的领域。已经有一些成功的模型和追踪可变形线性物体的方法。但是,在非三角情况下这些方法能够自动提取初始条件的方法数量有限,而且直到最近才引入社区。另一方面,虽然与地面操纵器进行了物理互动,但没有研究与空中机器人对变形线性物体进行物理互动和操纵的问题。本讲习班介绍了我们最近探测变形线性物体的工作,利用现有方法的分解输出自动提供跟踪方法所要求的初始化。它与过境点合作,可以填补分解中的空白和隔离,并生成适合物理互动和模拟的模型。然后我们介绍我们如何使用诸如与地面和航空机器人的路线和操纵等任务的方法。我们讨论了关于将物理互动扩大到这些物体的空中操纵的可行性分析。