State-of-the-art methods for semantic segmentation of images involve computationally intensive neural network architectures. Most of these methods are not adaptable to high-resolution image segmentation due to memory and other computational issues. Typical approaches in literature involve design of neural network architectures that can fuse global information from low-resolution images and local information from the high-resolution counterparts. However, architectures designed for processing high resolution images are unnecessarily complex and involve a lot of hyper parameters that can be difficult to tune. Also, most of these architectures require ground truth annotations of the high resolution images to train, which can be hard to obtain. In this article, we develop a robust pipeline based on mathematical morphological (MM) operators that can seamlessly extend any existing semantic segmentation algorithm to high resolution images. Our method does not require the ground truth annotations of the high resolution images. It is based on efficiently utilizing information from the low-resolution counterparts, and gradient information on the high-resolution images. We obtain high quality seeds from the inferred labels on low-resolution images using traditional morphological operators and propagate seed labels using a random walker to refine the semantic labels at the boundaries. We show that the semantic segmentation results obtained by our method beat the existing state-of-the-art algorithms on high-resolution images. We empirically prove the robustness of our approach to the hyper parameters used in our pipeline. Further, we characterize some necessary conditions under which our pipeline is applicable and provide an in-depth analysis of the proposed approach.
翻译:图像的语义分解最新方法涉及计算密集的神经网络结构。由于记忆和其他计算问题,这些方法大多无法适应高分辨率图像分解。文献中的典型方法涉及神经网络结构的设计,这种结构可以将低分辨率图像和高分辨率图像的当地信息结合起来。然而,为处理高分辨率图像而设计的结构不必要地复杂,涉及许多难以调控的超高参数。此外,这些结构大多需要用高分辨率图像进行地面的真相说明,而高分辨率图像的地面说明可能很难获得。在文章中,我们开发了一种基于数学形态学操作员(MMM)的可靠管道分析,可以无缝地将现有的任何语义分解算法扩展至高分辨率图像。我们的方法并不需要高分辨率图像的地面真相说明,而是高效地利用低分辨率对应方的信息和高分辨率图像的梯度信息。我们从使用传统形态学操作员的低分辨率图像的推导出的高分辨率标签中获得高质的种子。我们用数学形态操作员和种子标签的可应用的管道分析方法,在高分辨率解算法中,我们用我们目前所使用的某种高分辨率路路路路路路路路路路路路路路路路路路路路路段,我们用某种路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路路