Dexterous object manipulation remains an open problem in robotics, despite the rapid progress in machine learning during the past decade. We argue that a hindrance is the high cost of experimentation on real systems, in terms of both time and money. We address this problem by proposing an open-source robotic platform which can safely operate without human supervision. The hardware is inexpensive (about \SI{5000}[\$]{}) yet highly dynamic, robust, and capable of complex interaction with external objects. The software operates at 1-kilohertz and performs safety checks to prevent the hardware from breaking. The easy-to-use front-end (in C++ and Python) is suitable for real-time control as well as deep reinforcement learning. In addition, the software framework is largely robot-agnostic and can hence be used independently of the hardware proposed herein. Finally, we illustrate the potential of the proposed platform through a number of experiments, including real-time optimal control, deep reinforcement learning from scratch, throwing, and writing.
翻译:尽管在过去十年中机器学习方面进展迅速,但对非直接物体的操纵仍然是机器人的一个公开问题。我们争辩说,一个障碍是实际系统在时间和金钱方面的试验费用高昂。我们通过提出一个可以安全运行而不受人监督的开放源码机器人平台来解决这个问题。硬件价格低廉(约合 SI{5000}[\] $] ),但具有高度活力、强力和与外部物体进行复杂互动的能力。软件在1-kilohertz运行,并进行安全检查以防止硬件的破碎。容易使用的前端(在C++和Python)适合实时控制和深层强化学习。此外,软件框架基本上是机器人无能的,因此可以独立于此处提议的硬件使用。最后,我们通过一系列实验,包括实时最佳控制、从刮痕、扔和写作中深度强化学习,来说明拟议平台的潜力。