Single image deraining is important for many high-level computer vision tasks since the rain streaks can severely degrade the visibility of images, thereby affecting the recognition and analysis of the image. Recently, many CNN-based methods have been proposed for rain removal. Although these methods can remove part of the rain streaks, it is difficult for them to adapt to real-world scenarios and restore high-quality rain-free images with clear and accurate structures. To solve this problem, we propose a Structure-Preserving Deraining Network (SPDNet) with RCP guidance. SPDNet directly generates high-quality rain-free images with clear and accurate structures under the guidance of RCP but does not rely on any rain-generating assumptions. Specifically, we found that the RCP of images contains more accurate structural information than rainy images. Therefore, we introduced it to our deraining network to protect structure information of the rain-free image. Meanwhile, a Wavelet-based Multi-Level Module (WMLM) is proposed as the backbone for learning the background information of rainy images and an Interactive Fusion Module (IFM) is designed to make full use of RCP information. In addition, an iterative guidance strategy is proposed to gradually improve the accuracy of RCP, refining the result in a progressive path. Extensive experimental results on both synthetic and real-world datasets demonstrate that the proposed model achieves new state-of-the-art results. Code: https://github.com/Joyies/SPDNet
翻译:单一图像脱线对于许多高层次的计算机视觉任务很重要,因为雨量可以严重降低图像的可见度,从而影响图像的识别和分析。最近,提出了许多基于CNN的排除雨量的方法。虽然这些方法可以消除部分雨量,但它们很难适应现实世界的情景,恢复高质量的无雨图像,并有明确和准确的结构。为了解决这个问题,我们提议建立一个结构-保护脱线网络(SPDNet),由RECP提供指导。SPDNet直接生成高质量的无雨图像,在RCP的指导下,清晰和准确的结构,但不依赖任何产生雨的假设。具体地说,我们发现图像的RCP含有比雨量图像更准确的结构信息。因此,我们将其引入了我们的脱线网络,以保护无雨图像的结构信息。同时,我们提议建立一个基于Wavelet的多层模块(WMLMMMMM),作为学习降线图像和交互式Fusion 模块(IFM)背景信息的骨干骨干。此外,我们发现RCP的 RCP 的模型将最终数据用于不断改进。