A central question in neuroscience is how self-organizing dynamic interactions in the brain emerge on their relatively static structural backbone. Due to the complexity of spatial and temporal dependencies between different brain areas, fully comprehending the interplay between structure and function is still challenging and an area of intense research. In this paper we present a graph neural network (GNN) framework, to describe functional interactions based on the structural anatomical layout. A GNN allows us to process graph-structured spatio-temporal signals, providing a possibility to combine structural information derived from diffusion tensor imaging (DTI) with temporal neural activity profiles, like observed in functional magnetic resonance imaging (fMRI). Moreover, dynamic interactions between different brain regions learned by this data-driven approach can provide a multi-modal measure of causal connectivity strength. We assess the proposed model's accuracy by evaluating its capabilities to replicate empirically observed neural activation profiles, and compare the performance to those of a vector auto regression (VAR), like typically used in Granger causality. We show that GNNs are able to capture long-term dependencies in data and also computationally scale up to the analysis of large-scale networks. Finally we confirm that features learned by a GNN can generalize across MRI scanner types and acquisition protocols, by demonstrating that the performance on small datasets can be improved by pre-training the GNN on data from an earlier and different study. We conclude that the proposed multi-modal GNN framework can provide a novel perspective on the structure-function relationship in the brain. Therewith this approach can be promising for the characterization of the information flow in brain networks.
翻译:神经科学的一个中心问题是,大脑的自我组织动态互动如何在其相对静态的结构骨干中出现。由于不同大脑区域之间空间和时间依赖性的复杂性,充分理解结构与功能之间的相互作用仍然具有挑战性和激烈研究的领域。在本文件中,我们提出了一个图形神经网络框架(GNN),以描述基于结构解剖布局的功能性互动。GNN允许我们处理图表结构结构结构化的瞬时状态信号,从而有可能将从扩散成色成像(DTI)中得出的结构性信息与时间神经活动概况(如功能性磁感应成像(fMRI)中观察到的)结合起来。此外,通过这种数据驱动法学习的不同脑区域之间的动态互动可以提供因果连通强度的多模式。我们通过评估其复制实验性观测到的神经激活图谱的能力来评估拟议模型的准确性,并比较矢量式自动回归(VAR)的性能,像GNR通常在因果关系中那样使用。我们表明GNN能够从数据和计算结果的早期数据采集模型的模型,最终可以证实GNNM的大规模性分析。我们从数据和从G系统获得的大规模网络的模型中可以证实。