Given the recent advances with image-generating algorithms, deep image completion methods have made significant progress. However, state-of-art methods typically provide poor cross-scene generalization, and generated masked areas often contain blurry artifacts. Predictive filtering is a method for restoring images, which predicts the most effective kernels based on the input scene. Motivated by this approach, we address image completion as a filtering problem. Deep feature-level semantic filtering is introduced to fill in missing information, while preserving local structure and generating visually realistic content. In particular, a Dual-path Cooperative Filtering (DCF) model is proposed, where one path predicts dynamic kernels, and the other path extracts multi-level features by using Fast Fourier Convolution to yield semantically coherent reconstructions. Experiments on three challenging image completion datasets show that our proposed DCF outperforms state-of-art methods.
翻译:鉴于图像生成算法的最新进展,深度图像补全方法已经取得了显著进展。然而,目前的方法通常提供较差的跨场景泛化性能,而且所生成的掩模区域常常包含模糊的伪影。预测滤波是一种恢复图像的方法,它根据输入场景预测最有效的卷积核。受这种方法的启发,我们将图像补全看作一种滤波问题。我们引入了深度特征级语义滤波来填补缺失的信息,同时保留局部结构并生成视觉上逼真的内容。特别地,我们提出了一个双通道协同滤波(Dual-path Cooperative Filtering,DCF)模型,其中一个通道预测动态卷积核,另一个通道使用快速傅里叶卷积提取多级特征,从而生成语义上连贯的重建。在三个具有挑战性的图像补全数据集上的实验表明,我们提出的DCF方法优于现有的最先进方法。