Graph Neural Networks (GNNs) are a family of graph networks inspired by mechanisms existing between nodes on a graph. In recent years there has been an increased interest in GNN and their derivatives, i.e., Graph Attention Networks (GAT), Graph Convolutional Networks (GCN), and Graph Recurrent Networks (GRN). An increase in their usability in computer vision is also observed. The number of GNN applications in this field continues to expand; it includes video analysis and understanding, action and behavior recognition, computational photography, image and video synthesis from zero or few shots, and many more. This contribution aims to collect papers published about GNN-based approaches towards computer vision. They are described and summarized from three perspectives. Firstly, we investigate the architectures of Graph Neural Networks and their derivatives used in this area to provide accurate and explainable recommendations for the ensuing investigations. As for the other aspect, we also present datasets used in these works. Finally, using graph analysis, we also examine relations between GNN-based studies in computer vision and potential sources of inspiration identified outside of this field.
翻译:图表神经网络(GNNs)是一组图形网络,它受到图中节点之间现有机制的启发。近年来,人们对GNN及其衍生物,即图形关注网络(GAT)、图表革命网络(GCN)和图表经常网络(GRN)的兴趣日益浓厚。也观察到计算机视觉的使用性有所提高。这个领域的GNN应用程序数量继续扩大,包括视频分析和理解、行动和行为识别、计算摄影、图像和从零镜头或很少镜头的视频合成以及许多其他内容。这一资料旨在收集已发表的关于GNN(GN)的计算机视觉方法的文件,从三个角度加以描述和总结。首先,我们调查在这一领域使用的图形神经网络的结构及其衍生物,以便为随后的调查提供准确和可解释的建议。关于其他方面,我们还提供了这些作品中使用的数据集。最后,我们利用图表分析,还研究了基于GNNN的计算机视觉研究与这个领域外发现的潜在灵感来源之间的关系。