With many frameworks based on message passing neural networks proposed to predict molecular and bulk properties, machine learning methods have tremendously shifted the paradigms of computational sciences underpinning physics, material science, chemistry, and biology. While existing machine learning models have yielded superior performances in many occasions, most of them model and process molecular systems in terms of homogeneous graph, which severely limits the expressive power for representing diverse interactions. In practice, graph data with multiple node and edge types is ubiquitous and more appropriate for molecular systems. Thus, we propose the heterogeneous relational message passing network (HermNet), an end-to-end heterogeneous graph neural networks, to efficiently express multiple interactions in a single model with {\it ab initio} accuracy. HermNet performs impressively against many top-performing models on both molecular and extended systems. Specifically, HermNet outperforms other tested models in nearly 75\%, 83\% and 94\% of tasks on MD17, QM9 and extended systems datasets, respectively. Finally, we elucidate how the design of HermNet is compatible with quantum mechanics from the perspective of the density functional theory. Besides, HermNet is a universal framework, whose sub-networks could be replaced by other advanced models.
翻译:以信息传递神经网络为基础,提出了许多框架,以预测分子和散装特性,因此,机器学习方法大大改变了计算科学的范式,支撑物理学、材料科学、化学和生物学;虽然现有的机器学习模型在许多场合产生了优异的性能,但大多数是模型和过程分子系统,以同质图形为主,严重限制了代表不同互动的表达力。实际上,多节点和边缘类型的图形数据对分子系统来说是无处不在的,更合适。因此,我们建议混合关系信息传递网络(HermNet),一个端到端的多元图形神经网络,以高效地表达单一模型中的多种互动,且具有创前端的准确性。HermNet对分子和扩展系统中的许多顶级模型表现得惊人。具体地说,HermNet在近75 ⁇ 、83 ⁇ 和94 ⁇ (MD17、QM9和扩展系统数据集的任务中),分别优于其他测试模型。最后,我们解释了HermNet的设计如何与从密度功能理论框架的高级角度来兼容。此外,HERmNet的子功能理论框架可以取代。