Road extraction is a process of automatically generating road maps mainly from satellite images. Existing models all target to generate roads from the scratch despite that a large quantity of road maps, though incomplete, are publicly available (e.g. those from OpenStreetMap) and can help with road extraction. In this paper, we propose to conduct road extraction based on satellite images and partial road maps, which is new. We then propose a two-branch Partial to Complete Network (P2CNet) for the task, which has two prominent components: Gated Self-Attention Module (GSAM) and Missing Part (MP) loss. GSAM leverages a channel-wise self-attention module and a gate module to capture long-range semantics, filter out useless information, and better fuse the features from two branches. MP loss is derived from the partial road maps, trying to give more attention to the road pixels that do not exist in partial road maps. Extensive experiments are conducted to demonstrate the effectiveness of our model, e.g. P2CNet achieves state-of-the-art performance with the IoU scores of 70.71% and 75.52%, respectively, on the SpaceNet and OSM datasets.
翻译:道路提取是一种主要从卫星图像中自动生成道路地图的过程。现有的模型都针对从头开始生成道路,尽管有大量不完整的公共道路地图可用(例如来自 OpenStreetMap 的地图),这些地图可以帮助道路提取。本文提出了一种基于卫星图像和部分道路地图进行道路提取的方法,这是新的思路。然后提出了一种两支 Partial to Complete Network(P2CNet)用于该任务,具有两个突出组件: Gated Self-Attention Module(GSAM)和 Missing Part(MP)损失。 GSAM 利用一个通道注意力模块和一个门模块来捕捉长距离语义,过滤掉无用信息,并更好地融合两个分支的特征。 MP 损失源自部分道路地图,试图更多地关注部分道路地图中不存在的道路像素。进行了大量实验,以证明我们的模型的有效性,例如,P2CNet 在 SpaceNet 和 OSM 数据集上分别达到了 70.71% 和 75.52% 的 IoU 得分,居于最佳水平。