Grasping objects in cluttered environments remains a fundamental yet challenging problem in robotic manipulation. While prior works have explored learning-based synergies between pushing and grasping for two-fingered grippers, few have leveraged the high degrees of freedom (DoF) in dexterous hands to perform efficient singulation for grasping in cluttered settings. In this work, we introduce DexSinGrasp, a unified policy for dexterous object singulation and grasping. DexSinGrasp enables high-dexterity object singulation to facilitate grasping, significantly improving efficiency and effectiveness in cluttered environments. We incorporate clutter arrangement curriculum learning to enhance success rates and generalization across diverse clutter conditions, while policy distillation enables a deployable vision-based grasping strategy. To evaluate our approach, we introduce a set of cluttered grasping tasks with varying object arrangements and occlusion levels. Experimental results show that our method outperforms baselines in both efficiency and grasping success rate, particularly in dense clutter. Codes, appendix, and videos are available on our website https://nus-lins-lab.github.io/dexsingweb/.
翻译:在杂乱环境中抓取物体仍然是机器人操作领域一个基础且具有挑战性的问题。尽管先前的研究已经探索了基于学习的、针对二指夹爪的推动与抓取协同策略,但很少有工作利用灵巧手的高自由度(DoF)在杂乱场景中执行高效的物体分离以辅助抓取。在本工作中,我们提出了DexSinGrasp,一种用于灵巧物体分离与抓取的一体化策略。DexSinGrasp能够实现高灵巧度的物体分离以促进抓取,从而显著提高在杂乱环境中的操作效率与成功率。我们引入了杂乱排列课程学习机制,以提升策略在不同杂乱条件下的成功率和泛化能力,同时通过策略蒸馏技术实现了一种可部署的、基于视觉的抓取策略。为了评估我们的方法,我们设计了一套具有不同物体排列方式和遮挡程度的杂乱抓取任务。实验结果表明,我们的方法在操作效率和抓取成功率方面均优于基线方法,尤其是在密集杂乱场景中。代码、附录和视频可在我们的网站 https://nus-lins-lab.github.io/dexsingweb/ 上获取。