Super-Resolution is the technique to improve the quality of a low-resolution photo by boosting its plausible resolution. The computer vision community has extensively explored the area of Super-Resolution. However, previous Super-Resolution methods require vast amounts of data for training which becomes problematic in domains where very few low-resolution, high-resolution pairs might be available. One such area is statistical downscaling, where super-resolution is increasingly being used to obtain high-resolution climate information from low-resolution data. Acquiring high-resolution climate data is extremely expensive and challenging. To reduce the cost of generating high-resolution climate information, Super-Resolution algorithms should be able to train with a limited number of low-resolution, high-resolution pairs. This paper tries to solve the aforementioned problem by introducing a semi-supervised way to perform super-resolution that can generate sharp, high-resolution images with as few as 500 paired examples. The proposed semi-supervised technique can be used as a plug-and-play module with any supervised GAN-based Super-Resolution method to enhance its performance. We quantitatively and qualitatively analyze the performance of the proposed model and compare it with completely supervised methods as well as other unsupervised techniques. Comprehensive evaluations show the superiority of our method over other methods on different metrics. We also offer the applicability of our approach in statistical downscaling to obtain high-resolution climate images.
翻译:超级分辨率是提高低分辨率照片质量的方法,方法是通过提升其可信的分辨率,提高低分辨率照片的质量。计算机视觉界已广泛探索了超分辨率区域。然而,以往的超分辨率方法需要大量的培训数据,在很少低分辨率、高分辨率配对可能存在的领域,这些数据会产生问题。其中一个领域是统计降尺度,其中超级分辨率正越来越多地用于从低分辨率数据获取高分辨率气候信息。获取高分辨率气候数据非常昂贵且具有挑战性。为降低生成高分辨率气候信息的成本,超分辨率算法应当能够以数量有限的低分辨率高分辨率配对来培训。本文试图通过采用半超高分辨率方法执行超级分辨率图像,从而解决上述问题,这种超分辨率图像能够产生锐利、高分辨率图像,只有500个匹配实例。拟议的半超分辨率技术可以用作一个插接和播放模块,由任何以GAN为基础的超分辨率监督的超分辨率方法,以提高其性能。我们从定量和定性角度分析拟议的高分辨率模型的性能,并将其他高分辨率方法加以比较。我们提出的高分辨率模型的通用方法也以其他监督方式展示。