High-resolution satellite imagery is a key element for many Earth monitoring applications. Satellites such as Sentinel-2 feature characteristics that are favorable for super-resolution algorithms such as aliasing and band-misalignment. Unfortunately the lack of reliable high-resolution (HR) ground truth limits the application of deep learning methods to this task. In this work we propose L1BSR, a deep learning-based method for single-image super-resolution and band alignment of Sentinel-2 L1B 10m bands. The method is trained with self-supervision directly on real L1B data by leveraging overlapping areas in L1B images produced by adjacent CMOS detectors, thus not requiring HR ground truth. Our self-supervised loss is designed to enforce the super-resolved output image to have all the bands correctly aligned. This is achieved via a novel cross-spectral registration network (CSR) which computes an optical flow between images of different spectral bands. The CSR network is also trained with self-supervision using an Anchor-Consistency loss, which we also introduce in this work. We demonstrate the performance of the proposed approach on synthetic and real L1B data, where we show that it obtains comparable results to supervised methods.
翻译:高分辨率卫星图像对许多地球监测应用至关重要。像 Sentinel-2 这样的卫星具有超采样和波段错位等对超分辨率算法有利的特征。不幸的是,可靠的高分辨率地面真值缺乏,这限制了深度学习方法在此任务中的应用。在此工作中,我们提出了一种称为 L1BSR 的基于深度学习的方法,用于单幅图像超分辨率和 Sentinel-2 L1B 10m 波段的波段对齐。该方法通过利用相邻 CMOS 检测器产生的 L1B 图像中的重叠区域,直接在实际的 L1B 数据上进行自监督训练,从而不需要高分辨率的地面真值。我们的自监督损失旨在通过新颖的交叉光谱登记网络 (CSR),强制超分辨输出图像的所有波段正确对齐。CSR 网络也使用锚点一致性损失进行自监督训练,我们在本文中也介绍了该损失。我们在合成和真实的 L1B 数据上演示了所提出方法的性能,在其中我们展示了它相当于监督方法的结果。