Most deep learning-based super-resolution (SR) methods are not image-specific: 1) They are exhaustively trained on datasets synthesized by predefined blur kernels (\eg bicubic), regardless of the domain gap with test images. 2) Their model weights are fixed during testing, which means that test images with various degradations are super-resolved by the same set of weights. However, degradations of real images are various and unknown (\ie blind SR). It is hard for a single model to perform well in all cases. To address these issues, we propose an online super-resolution (ONSR) method. It does not rely on predefined blur kernels and allows the model weights to be updated according to the degradation of the test image. Specifically, ONSR consists of two branches, namely internal branch (IB) and external branch (EB). IB could learn the specific degradation of the given test LR image, and EB could learn to super resolve images degraded by the learned degradation. In this way, ONSR could customize a specific model for each test image, and thus could be more tolerant with various degradations in real applications. Extensive experiments on both synthesized and real-world images show that ONSR can generate more visually favorable SR results and achieve state-of-the-art performance in blind SR.
翻译:最深的基于学习的超分辨率(SR)方法不针对具体图像:1)这些方法在使用预先定义的模糊内核合成的数据集((eg bicubic)方面受过详尽的培训,而不论测试图像的域差。2)其模型重量在测试期间固定,这意味着各种降解的测试图像由同一数组重量超解。然而,真实图像的退化是多种和未知的(\ 盲人 SR)。对于单一模型来说,很难在所有情况下都很好地发挥作用。为了解决这些问题,我们建议了一种在线超级分辨率(ONSR)方法。它不依赖于预先定义的模糊内核,允许模型重量根据测试图像的退化进行更新。具体地说,ONSR由两个分支组成,即内部分支(IB)和外部分支(EB)。IB可以学习给定的测试 LR图像的具体退化,而EB可以学习如何在所学的降解中超解析图像。通过这种方式,ONSR可以为每个测试图像定制一个具体的模型,因此可以更加宽容地在图像中进行真正的合成。