Inverse problems consist in reconstructing signals from incomplete sets of measurements and their performance is highly dependent on the quality of the prior knowledge encoded via regularization. While traditional approaches focus on obtaining a unique solution, an emerging trend considers exploring multiple feasibile solutions. In this paper, we propose a method to generate multiple reconstructions that fit both the measurements and a data-driven prior learned by a generative adversarial network. In particular, we show that, starting from an initial solution, it is possible to find directions in the latent space of the generative model that are null to the forward operator, and thus keep consistency with the measurements, while inducing significant perceptual change. Our exploration approach allows to generate multiple solutions to the inverse problem an order of magnitude faster than existing approaches; we show results on image super-resolution and inpainting problems.
翻译:反面问题在于从不完全的成套测量中重建信号,其性能在很大程度上取决于通过正规化编码的先前知识的质量。传统方法侧重于获得一种独特的解决办法,而新出现的趋势则考虑探索多种易碎性解决办法。在本文件中,我们提出一种方法来产生多种重建,既适合测量方法,又适合以前通过基因对抗网络学过的数据驱动方法。特别是,我们表明,从最初的解决办法开始,有可能在基因模型的潜在空间找到方向,而基因模型对前方操作者来说是无效的,因此与测量方法保持一致,同时产生显著的观念变化。我们的探索方法使得对反向问题产生多种解决办法,其规模比现有方法要快得多;我们在图像超分辨率和成因问题上展示了结果。