Purpose: Trans-oral robotic surgery (TORS) using the da Vinci surgical robot is a new minimally-invasive surgery method to treat oropharyngeal tumors, but it is a challenging operation. Augmented reality (AR) based on intra-operative ultrasound (US) has the potential to enhance the visualization of the anatomy and cancerous tumors to provide additional tools for decision-making in surgery. Methods: We propose and carry out preliminary evaluations of a US-guided AR system for TORS, with the transducer placed on the neck for a transcervical view. Firstly, we perform a novel MRI-transcervical 3D US registration study. Secondly, we develop a US-robot calibration method with an optical tracker and an AR system to display the anatomy mesh model in the real-time endoscope images inside the surgeon console. Results: Our AR system reaches a mean projection error of 26.81 and 27.85 pixels for the projection from the US to stereo cameras in a water bath experiment. The average target registration error for MRI to 3D US is 8.90 mm for the 3D US transducer and 5.85 mm for freehand 3D US, and the average distance between the vessel centerlines is 2.32 mm. Conclusion: We demonstrate the first proof-of-concept transcervical US-guided AR system for TORS and the feasibility of trans-cervical 3D US-MRI registration. Our results show that trans-cervical 3D US is a promising technique for TORS image guidance.
翻译:目的 : 使用达芬奇手术机器人的跨口头机器人手术(TORS) 使用达芬奇手术机器人(TORS) 是一种治疗奥氏肿瘤的新型最低侵入性手术方法,但这是一项具有挑战性的手术。基于手术室超声波(美国)的强化现实(AR) 有可能提高解剖和癌症肿瘤的视觉化,为外科手术的决策提供更多工具。 方法: 我们提议并初步评估美国为TORS制导的AR系统(TORS), 将转诊器放在颈部的转诊器上。 首先, 我们进行了新型的MRI- Transcellal 3D 美国注册研究。 其次, 我们开发了一个有光学追踪器的美国机器人校准系统(ARAR)校准方法, 在外科手术室的实时内镜图象图像中显示一个解剖图模模型。 结果: 我们的ARS系统在水浴实验中从美国向立摄像头3摄像头的 。 MARI 到3D 平均目标注册错误: 我们的MA-D 3MRI-D 和ROD 3MMMMMMM- NL 3- NL 显示我们3- D 3- RV 3- RV 3- RV 3-M-M-M-M-M-M-M- RV 3-M- N 3- RV 3-M-M- RS 3- RS 3-R 显示我们 3- 3- RS 3- 3-R- RV 3-M-R-R-R-R- RV.