Robotic ultrasound (US) imaging has been seen as a promising solution to overcome the limitations of free-hand US examinations, i.e., inter-operator variability. However, the fact that robotic US systems cannot react to subject movements during scans limits their clinical acceptance. Regarding human sonographers, they often react to patient movements by repositioning the probe or even restarting the acquisition, in particular for the scans of anatomies with long structures like limb arteries. To realize this characteristic, we proposed a vision-based system to monitor the subject's movement and automatically update the scan trajectory thus seamlessly obtaining a complete 3D image of the target anatomy. The motion monitoring module is developed using the segmented object masks from RGB images. Once the subject is moved, the robot will stop and recompute a suitable trajectory by registering the surface point clouds of the object obtained before and after the movement using the iterative closest point algorithm. Afterward, to ensure optimal contact conditions after repositioning US probe, a confidence-based fine-tuning process is used to avoid potential gaps between the probe and contact surface. Finally, the whole system is validated on a human-like arm phantom with an uneven surface, while the object segmentation network is also validated on volunteers. The results demonstrate that the presented system can react to object movements and reliably provide accurate 3D images.
翻译:机器人超声波(US)成像被视为一个很有希望的解决方案,可以克服美国自由手式检查的限制,即操作者之间的变异性。然而,美国机器人系统无法在扫描过程中对运动进行反应这一事实限制了临床的接受度。对于人类声学学家来说,它们往往通过重新定位探测器来对病人的移动作出反应,甚至恢复获取过程,特别是对于使用肢体动脉等长结构的解剖扫描。为了实现这一特征,我们提议了一个基于愿景的系统来监测对象的移动并自动更新扫描轨迹,从而天衣无缝地取得目标解剖完整的3D图像。运动监测模块是使用RGB图像的断面对象面遮罩开发的。一旦移动,机器人将停止并重新配置适当的轨迹,通过对在移动之前和之后获得的物体的表面点云进行登记,使用迭接最接近的算法。随后,为了确保最佳的接触条件,我们采用了基于信任的微调程序,以避免探测器和接触对象表面物体之间的潜在差距。最后,整个运动监测模块将提供一个稳定的网络,同时向一个稳定的网络进行模拟反应。