Single image super-resolution (SISR) aims to obtain a high-resolution output from one low-resolution image. Currently, deep learning-based SISR approaches have been widely discussed in medical image processing, because of their potential to achieve high-quality, high spatial resolution images without the cost of additional scans. However, most existing methods are designed for scale-specific SR tasks and are unable to generalise over magnification scales. In this paper, we propose an approach for medical image arbitrary-scale super-resolution (MIASSR), in which we couple meta-learning with generative adversarial networks (GANs) to super-resolve medical images at any scale of magnification in (1, 4]. Compared to state-of-the-art SISR algorithms on single-modal magnetic resonance (MR) brain images (OASIS-brains) and multi-modal MR brain images (BraTS), MIASSR achieves comparable fidelity performance and the best perceptual quality with the smallest model size. We also employ transfer learning to enable MIASSR to tackle SR tasks of new medical modalities, such as cardiac MR images (ACDC) and chest computed tomography images (COVID-CT). The source code of our work is also public. Thus, MIASSR has the potential to become a new foundational pre-/post-processing step in clinical image analysis tasks such as reconstruction, image quality enhancement, and segmentation.
翻译:单一图像超分辨率(SISR)的目的是从一个低分辨率图像中获得高分辨率的超分辨率输出。目前,在医学图像处理中,人们广泛讨论了深层次学习的SISSR方法,因为这些方法有可能实现高质量、高空间分辨率图像,而无需额外的扫描费用。然而,大多数现有方法是为特定规模的SR任务设计的,无法对放大尺度进行概括化。在本文件中,我们提出了医学图像任意规模超分辨率(MIASSR)的方法,其中我们把与基因对抗网络(GANs)的元学习与任何规模放大规模的超解医学图像(GANs)结合起来。与单一模式磁共振动大脑图像(OASIS-brains)和多模式MRMR图像(BATS)的先进模型(MASSR)最接近的忠诚性表现和最佳感知性质量。我们还利用转移学习使MIASSR公司能够应对新的医学模式(GAN)的超级解析医学模式任务,例如心脏分层图像(AS-MR)的升级成像分析。