In recent years, considerable advancements have been made in the area of Generative Adversarial Networks (GANs), particularly with the advent of style-based architectures that address many key shortcomings - both in terms of modeling capabilities and network interpretability. Despite these improvements, the adoption of such approaches in the domain of satellite imagery is not straightforward. Typical vision datasets used in generative tasks are well-aligned and annotated, and exhibit limited variability. In contrast, satellite imagery exhibits great spatial and spectral variability, wide presence of fine, high-frequency details, while the tedious nature of annotating satellite imagery leads to annotation scarcity - further motivating developments in unsupervised learning. In this light, we present the first pre-trained style- and wavelet-based GAN model that can readily synthesize a wide gamut of realistic satellite images in a variety of settings and conditions - while also preserving high-frequency information. Furthermore, we show that by analyzing the intermediate activations of our network, one can discover a multitude of interpretable semantic directions that facilitate the guided synthesis of satellite images in terms of high-level concepts (e.g., urbanization) without using any form of supervision. Via a set of qualitative and quantitative experiments we demonstrate the efficacy of our framework, in terms of suitability for downstream tasks (e.g., data augmentation), quality of synthetic imagery, as well as generalization capabilities to unseen datasets.
翻译:近年来,在Generation Adversarial Network(GANs)领域取得了相当大的进展,特别是出现了基于风格的结构,解决了许多关键缺陷――无论是建模能力和网络可解释性两方面的缺陷;尽管取得了这些改进,在卫星图像领域采用这类办法并非直截了当,在卫星图像领域采用这类办法并非直截了当;在基因化任务中使用的典型的视觉数据集非常吻合和附加说明,而且变化有限;相比之下,卫星图像在空间和光谱方面差异很大,广泛存在精细和高频的细节,而说明卫星图像的冗长性质导致注释短缺――进一步激励在不受监督的学习中出现发展;在这方面,我们介绍了第一个经过培训的基于样式和波列的GAN模型,该模型可以在各种环境和条件下很容易地综合广泛的现实卫星图像,同时保存高频信息;此外,我们通过分析我们的网络的中间激活,可以发现多种可解释的语义方向,这种方向有助于以高层次的图像能力(例如我们作为高层次的高级质量概念、高质量、高质量的升级框架)来指导卫星图像的合成合成合成合成图像的合成合成合成合成合成,而不以显示我们作为数据结构的升级的升级的模型。