Single-image super-resolution (SISR) has achieved significant breakthroughs with the development of deep learning. However, these methods are difficult to be applied in real-world scenarios since they are inevitably accompanied by the problems of computational and memory costs caused by the complex operations. To solve this issue, we propose a Lightweight Bimodal Network (LBNet) for SISR. Specifically, an effective Symmetric CNN is designed for local feature extraction and coarse image reconstruction. Meanwhile, we propose a Recursive Transformer to fully learn the long-term dependence of images thus the global information can be fully used to further refine texture details. Studies show that the hybrid of CNN and Transformer can build a more efficient model. Extensive experiments have proved that our LBNet achieves more prominent performance than other state-of-the-art methods with a relatively low computational cost and memory consumption. The code is available at https://github.com/IVIPLab/LBNet.
翻译:随着深层学习的发展,单一图像超分辨率(SISR)取得了重大突破,但是,这些方法很难应用于现实世界情景中,因为它们不可避免地伴随着复杂操作造成的计算和记忆成本问题。为了解决这个问题,我们提议为SISR建立一个轻量级双模网络(LBNet)。具体地说,一个有效的Symatic CNN是为本地特征提取和粗略图像重建设计的。与此同时,我们提议一个精密的转换器,以充分了解图像的长期依赖性,从而可以充分利用全球信息来进一步改进纹理细节。研究表明CNN和变异器的混合可以建立一个效率更高的模型。广泛的实验证明,我们的LBNet比其他最先进的计算成本和记忆消耗率都高。该代码可在https://github.com/IVIPLab/LBNet上查阅。