Accurate tracking of an anatomical landmark over time has been of high interests for disease assessment such as minimally invasive surgery and tumor radiation therapy. Ultrasound imaging is a promising modality benefiting from low-cost and real-time acquisition. However, generating a precise landmark tracklet is very challenging, as attempts can be easily distorted by different interference such as landmark deformation, visual ambiguity and partial observation. In this paper, we propose a long-short diffeomorphic motion network, which is a multi-task framework with a learnable deformation prior to search for the plausible deformation of landmark. Specifically, we design a novel diffeomorphism representation in both long and short temporal domains for delineating motion margins and reducing long-term cumulative tracking errors. To further mitigate local anatomical ambiguity, we propose an expectation maximisation motion alignment module to iteratively optimize both long and short deformation, aligning to the same directional and spatial representation. The proposed multi-task system can be trained in a weakly-supervised manner, which only requires few landmark annotations for tracking and zero annotation for long-short deformation learning. We conduct extensive experiments on two ultrasound landmark tracking datasets. Experimental results show that our proposed method can achieve better or competitive landmark tracking performance compared with other state-of-the-art tracking methods, with a strong generalization capability across different scanner types and different ultrasound modalities.
翻译:长期以来,对解剖学里程碑的准确跟踪一直具有很高的兴趣,如最小侵入性外科手术和肿瘤辐射治疗等疾病评估。超声成像是一种前景良好的模式,从低成本和实时获取中获益。然而,产生一个精确的里程碑轨道非常具有挑战性,因为尝试很容易被不同干扰扭曲,如里程碑变形、视觉模糊和部分观察等。在本文件中,我们提议建立一个长短的地貌变形运动网络,这是一个多任务框架,在寻找标志性貌似变形之前,可以学习变形。具体地说,我们设计了一种新颖的长时空变形代表模式,用于缩小运动间间间间隔和减少长期累积跟踪错误。为进一步减轻局部解剖学模糊性,我们提议了预期最大运动调整模块,以迭代优化长和短的变形变形,与同一方向和空间代表相一致。拟议中的多任务系统可以以薄弱的超时超度方式加以培训,这只需要在跟踪和零变形的轨迹描述方面留下标志性说明。我们提出的两个标志性标志性说明,用来进行长期跟踪跟踪和超轨迹跟踪的超轨方法,我们提出的其他的超度追踪能力,可以广泛进行。