Stochastic partial differential equations (SPDEs) are the mathematical tool of choice for modelling dynamical systems evolving under the influence of randomness. We introduce a novel neural architecture to learn solution operators of PDEs with (possibly stochastic) forcing from partially observed data. The proposed \emph{Neural SPDE} model provides an extension to two popular classes of physics-inspired architectures. On the one hand, it extends Neural CDEs, SDEs, RDEs -- continuous-time analogues of RNNs -- in that it is capable of processing incoming sequential information arriving at an arbitrary resolution, both in space and in time. On the other hand, it extends Neural Operators -- generalizations of neural networks to model mappings between spaces of functions -- in that it can be used to learn solution operators of SPDEs (a.k.a. It\^o maps) depending simultaneously on the initial condition and a realization of the driving noise. By transferring some of its operations to the spectral domain, we show how a Neural SPDE can be evaluated either calling an ODE solver or solving a fixed point problem, inheriting in both cases memory-efficient backpropagation capabilities for training provided by existing adjoint-based or implicit-differentiation-based methods. Experiments on various semilinear SPDEs (including stochastic Navier-Stokes) demonstrate how our model is capable of learning complex spatiotemporal dynamics with better accuracy and using only a modest amount of training data compared to all alternative models, and its evaluation is up to 3 orders of magnitude faster than traditional solvers.
翻译:软化部分差异方程式(SPDEs)是模拟在随机性影响下演变的动态系统的数学选择工具。 我们引入了一个新的神经结构, 学习PDEs的解决方案操作员, 其( 可能具有随机性) 迫使部分观测的数据。 提议的 emph{ Neural SPDE} 模型可以扩展到物理启发建筑的两个受欢迎的类别。 一方面, 它扩展神经CDEs、 SDEs、 RDEs -- REDEs -- 传统NNS的连续时间模拟 -- 因为它能够处理以任意的解析方式到达的相继信息, 无论是在空间还是时间。 另一方面, 它扩展神经操作员 -- -- 神经操作员( 神经操作员的常规化) 来模拟功能空间之间的绘图。 它可以同时学习SPDEs( a. k. a. a. a.