In this paper, we propose an efficient self-supervised arbitrary-scale super-resolution (SR) framework to reconstruct isotropic magnetic resonance (MR) images from anisotropic MRI inputs without involving external training data. The proposed framework builds a training dataset using in-the-wild anisotropic MR volumes with arbitrary image resolution. We then formulate the 3D volume SR task as a SR problem for 2D image slices. The anisotropic volume's high-resolution (HR) plane is used to build the HR-LR image pairs for model training. We further adapt the implicit neural representation (INR) network to implement the 2D arbitrary-scale image SR model. Finally, we leverage the well-trained proposed model to up-sample the 2D LR plane extracted from the anisotropic MR volumes to their HR views. The isotropic MR volumes thus can be reconstructed by stacking and averaging the generated HR slices. Our proposed framework has two major advantages: (1) It only involves the arbitrary-resolution anisotropic MR volumes, which greatly improves the model practicality in real MR imaging scenarios (e.g., clinical brain image acquisition); (2) The INR-based SR model enables arbitrary-scale image SR from the arbitrary-resolution input image, which significantly improves model training efficiency. We perform experiments on a simulated public adult brain dataset and a real collected 7T brain dataset. The results indicate that our current framework greatly outperforms two well-known self-supervised models for anisotropic MR image SR tasks.
翻译:在本文中,我们提出了一种高效的自监督任意比例超分辨率(SR)框架,用于从各向异性MRI输入中重建等轴磁共振(MR)图像,而不需要涉及外部训练数据。所提出的框架使用现有的各向异性MR体积建立训练数据集,具有任意图像分辨率。然后,我们将三维体积SR任务制定为二维图像切片的SR问题。各向异性体积的高分辨率(HR)平面用于构建HR-LR图像对,用于模型训练。我们进一步采用隐式神经表示(INR)网络来实现2D任意比例图像SR模型。最后,我们利用训练良好的提议模型将从各向异性MR体积中提取的2D LR平面上采样到它们的HR视图。因此,通过堆叠和平均生成的HR切片,可以重建等轴MR体积。我们提出的框架具有两个主要优点:(1)它仅涉及任意分辨率的各向异性MR体积,大大提高了模型在实际MR成像场景(例如临床脑成像)中的实用性;(2)基于INR的SR模型使得可以从任意分辨率的输入图像进行任意比例的图像SR,显著提高了模型训练效率。我们在模拟的公开成年人脑数据集和收集的7T脑数据集上进行实验。结果表明,我们目前的框架在各向异性MR图像SR任务中远远优于两个着名的自监督模型。