Previous methods on multimodal groupwise registration typically require certain highly specialized similarity metrics with restrained applicability. In this work, we instead propose a general framework which formulates groupwise registration as a procedure of hierarchical Bayesian inference. Here, the imaging process of multimodal medical images, including shape transition and appearance variation, is characterized by a disentangled variational auto-encoder. To this end, we propose a novel variational posterior and network architecture that facilitate joint learning of the common structural representation and the desired spatial correspondences. The performance of the proposed model was validated on two publicly available multimodal datasets, i.e., BrainWeb and MS-CMR of the heart. Results have demonstrated the efficacy of our framework in realizing multimodal groupwise registration in an end-to-end fashion.
翻译:在这项工作中,我们提议了一个总体框架,将集体登记作为按巴耶斯等级推论的程序。这里,多式联运医学图像的成像过程,包括形状转变和外观变异,其特点是一个分解的自动自动编码变异。为此,我们提议一个新的变异后继体和网络结构,促进共同学习共同结构代表性和所希望的空间通信。拟议的模型的性能在两个公开的多式数据集上得到验证,即心脏的BrainWeb和MS-CMR。结果表明,我们框架在以端对端的方式实现多式集团登记方面的效力。