Convolutional neural networks have been widely applied to hyperspectral image classification. However, traditional convolutions can not effectively extract features for objects with irregular distributions. Recent methods attempt to address this issue by performing graph convolutions on spatial topologies, but fixed graph structures and local perceptions limit their performances. To tackle these problems, in this paper, different from previous approaches, we perform the superpixel generation on intermediate features during network training to adaptively produce homogeneous regions, obtain graph structures, and further generate spatial descriptors, which are served as graph nodes. Besides spatial objects, we also explore the graph relationships between channels by reasonably aggregating channels to generate spectral descriptors. The adjacent matrices in these graph convolutions are obtained by considering the relationships among all descriptors to realize global perceptions. By combining the extracted spatial and spectral graph features, we finally obtain a spectral-spatial graph reasoning network (SSGRN). The spatial and spectral parts of SSGRN are separately called spatial and spectral graph reasoning subnetworks. Comprehensive experiments on four public datasets demonstrate the competitiveness of the proposed methods compared with other state-of-the-art graph convolution-based approaches.
翻译:卷积神经网络已广泛应用于高光谱图像分类。然而,传统卷积无法有效地提取具有不规则分布的对象的特征。最近的方法尝试通过在空间拓扑上执行图卷积来解决此问题,但是固定的图结构和局部感知限制了其性能。为解决这些问题,在本文中,我们在网络训练期间对中间特征进行超像素生成,以自适应地产生均质区域,获得图结构,并进一步产生空间描述符,作为图节点。除了空间对象外,我们还通过合理聚合通道来生成频谱描述符,探索通道之间的图关系。这些图卷积中的相邻矩阵是通过考虑所有描述符之间的关系来获得全局感知。通过结合提取的空间和频谱图特征,我们最终获得了一种频谱-空间图推理网络(SSGRN)。SSGRN的空间部分和频谱部分分别称为空间图推理子网络和频谱图推理子网络。对四个公共数据集的综合实验表明,与其他最先进的基于图卷积的方法相比,所提出的方法具有竞争力。