Existing deep learning methods for solving mean-field games (MFGs) with common noise fix the sampling common noise paths and then solve the corresponding MFGs. This leads to a nested-loop structure with millions of simulations of common noise paths in order to produce accurate solutions, which results in prohibitive computational cost and limits the applications to a large extent. In this paper, based on the rough path theory, we propose a novel single-loop algorithm, named signatured deep fictitious play, by which we can work with the unfixed common noise setup to avoid the nested-loop structure and reduce the computational complexity significantly. The proposed algorithm can accurately capture the effect of common uncertainty changes on mean-field equilibria without further training of neural networks, as previously needed in the existing machine learning algorithms. The efficiency is supported by three applications, including linear-quadratic MFGs, mean-field portfolio game, and mean-field game of optimal consumption and investment. Overall, we provide a new point of view from the rough path theory to solve MFGs with common noise with significantly improved efficiency and an extensive range of applications. In addition, we report the first deep learning work to deal with extended MFGs (a mean-field interaction via both the states and controls) with common noise.
翻译:在本文中,根据粗略路径理论,我们提出了一个名为 " 深层虚拟游戏 " 的新型单行棋算法,它被命名为 " 深层虚拟游戏 ",通过这种游戏,我们可以与未固定的通用噪声装置合作,避免嵌入环形结构,并大大减少计算复杂性。提议的算法可以准确地捕捉到普通静态变化对中位静态结构的影响,而无需按照现有机器学习算法的要求,对神经网络进行进一步培训,从而产生令人望而却步的计算成本,并在很大程度上限制应用。在本文中,我们根据粗略路径理论,提出了一个新的名为 " 深层模拟游戏 " 的单行棋子算法,通过这种算法,我们可以与未固定的常见的杂音装置合作,避免嵌入环形结构,并大幅降低计算复杂性。拟议的算法可以准确地捕捉到普通的不确定性变化对中位线网的影响,而无需对现有机器学习算法系统进行进一步培训。效率得到三个应用的支持,包括线式宽宽度MF、中组合游戏以及最佳消费和投资的中场游戏。总体而言,我们从粗路理论的角度提出了一个新的观点,以便以大大改进通用的噪音解决MFG,通过共同的噪音和广泛的应用。