Purpose: Digital twins are virtual interactive models of the real world, exhibiting identical behavior and properties. In surgical applications, computational analysis from digital twins can be used, for example, to enhance situational awareness. Methods: We present a digital twin framework for skull-base surgeries, named Twin-S, which can be integrated within various image-guided interventions seamlessly. Twin-S combines high-precision optical tracking and real-time simulation. We rely on rigorous calibration routines to ensure that the digital twin representation precisely mimics all real-world processes. Twin-S models and tracks the critical components of skull-base surgery, including the surgical tool, patient anatomy, and surgical camera. Significantly, Twin-S updates and reflects real-world drilling of the anatomical model in frame rate. Results: We extensively evaluate the accuracy of Twin-S, which achieves an average 1.39 mm error during the drilling process. We further illustrate how segmentation masks derived from the continuously updated digital twin can augment the surgical microscope view in a mixed reality setting, where bone requiring ablation is highlighted to provide surgeons additional situational awareness. Conclusion: We present Twin-S, a digital twin environment for skull-base surgery. Twin-S tracks and updates the virtual model in real-time given measurements from modern tracking technologies. Future research on complementing optical tracking with higher-precision vision-based approaches may further increase the accuracy of Twin-S.
翻译:数字双胞胎是真实世界的虚拟互动模型,具有相同的行为和特性。在外科应用中,数字双胞胎的计算分析可以用来提高局势意识。方法:我们为头骨基外科手术提供了一个名为双S的数码双胞胎框架,可以无缝地纳入各种图像指导干预措施。双胞胎将高精度光学跟踪和实时模拟结合起来。我们依靠严格的校正常规来确保数字双胞胎代表精确地模仿现实世界的所有过程。双胞胎模型和跟踪头骨基外科手术的关键组成部分,包括外科工具、病人解剖和手术相机。重要,双胞胎系统更新并反映骨质模型在框架率方面的真实世界钻探情况。结果:我们广泛评价双胞胎S的准确性,在钻探过程中平均出现1.39毫米的错误。我们进一步说明从不断更新的数字双胞胎中产生的分解面罩如何在混合的现实环境中增强外科显微镜视图的视角。骨质需要突出骨质,以便外科外科外科医生进一步了解情况、病人解剖面和外科相机。双胞检查双胞骨质调查。我们现在的双骨质智能研究基础-S虚拟智能跟踪研究基础。