The capability to detect boulders on the surface of small bodies is beneficial for vision-based applications such as navigation and hazard detection during critical operations. This task is challenging due to the wide assortment of irregular shapes, the characteristics of the boulders population, and the rapid variability in the illumination conditions. The authors address this challenge by designing a multi-step training approach to develop a data-driven image processing pipeline to robustly detect and segment boulders scattered over the surface of a small body. Due to the limited availability of labeled image-mask pairs, the developed methodology is supported by two artificial environments designed in Blender specifically for this work. These are used to generate a large amount of synthetic image-label sets, which are made publicly available to the image processing community. The methodology presented addresses the challenges of varying illumination conditions, irregular shapes, fast training time, extensive exploration of the architecture design space, and domain gap between synthetic and real images from previously flown missions. The performance of the developed image processing pipeline is tested both on synthetic and real images, exhibiting good performances, and high generalization capabilities
翻译:小型机体表面探测巨石的能力有利于在关键操作期间进行导航和危险探测等基于愿景的应用,因为非正常形状分布广泛,巨石群的特性以及照明条件的迅速变化,因此这项任务具有挑战性。作者通过设计一个多阶段培训方法来应对这一挑战,以开发数据驱动图像处理管道,以强有力地探测小机体表面上散布的成像镜和碎块巨石。由于贴有标签的成像镜对的可用性能有限,在Blender专为这项工作设计的两种人工环境为开发的方法提供了支持。这些方法用于产生大量合成图像标签,这些标签向图像处理界公开提供。所介绍的方法应对了不同照明条件、不正规形状、快速培训时间、广泛探索建筑设计空间以及以前飞行飞行任务的合成图像与真实图像之间的域隔。发达的图像处理管道的性能通过合成图像和真实图像、展示良好性能以及高一般化能力测试了合成图像处理能力。