Image registration is a fundamental task for medical imaging. Resampling of the intensity values is required during registration and better spatial resolution with finer and sharper structures can improve the resampling performance and hence the registration accuracy. Super-resolution (SR) is an algorithmic technique targeting at spatial resolution enhancement which can achieve an image resolution beyond the hardware limitation. In this work, we consider SR as a preprocessing technique and present a CNN-based resolution enhancement module (REM) which can be easily plugged into the registration network in a cascaded manner. Different residual schemes and network configurations of REM are investigated to obtain an effective architecture design of REM. In fact, REM is not confined to image registration, it can also be straightforwardly integrated into other vision tasks for enhanced resolution. The proposed REM is thoroughly evaluated for deformable registration on medical images quantitatively and qualitatively at different upscaling factors. Experiments on LPBA40 brain MRI dataset demonstrate that REM not only improves the registration accuracy, especially when the input images suffer from degraded spatial resolution, but also generates resolution enhanced images which can be exploited for successive diagnosis.
翻译:图像登记是医学成像的一项基本任务。在登记期间,需要用更精细和更锋利的结构对强度值进行抽比,改进空间分辨率,这样可以提高再抽样性能,从而提高登记准确性。超级分辨率(SR)是一种针对空间分辨率增强的算法技术,可以达到超出硬件限制的图像分辨率。在这项工作中,我们认为SR是一种预处理技术,并提出了一个基于CNN的分辨率增强模块(REM),该模块可以很容易地以连锁方式插入登记网络。对REM的不同残余方案和网络配置进行了调查,以获得REM的有效结构设计。事实上,REM不限于图像登记,它也可以直接纳入其他强化分辨率的视觉任务中。对拟议的REM进行了彻底评估,以便按不同比例因素对医疗图像进行定量和定性的变形登记。LPBA40脑MRI数据集实验表明,REM不仅提高了登记准确性,特别是当输入图像由于空间分辨率下降,而且还生成了分辨率增强的图像,可用于连续诊断。