Modeling a system's temporal behaviour in reaction to external stimuli is a fundamental problem in many areas. Pure Machine Learning (ML) approaches often fail in the small sample regime and cannot provide actionable insights beyond predictions. A promising modification has been to incorporate expert domain knowledge into ML models. The application we consider is predicting the progression of disease under medications, where a plethora of domain knowledge is available from pharmacology. Pharmacological models describe the dynamics of carefully-chosen medically meaningful variables in terms of systems of Ordinary Differential Equations (ODEs). However, these models only describe a limited collection of variables, and these variables are often not observable in clinical environments. To close this gap, we propose the latent hybridisation model (LHM) that integrates a system of expert-designed ODEs with machine-learned Neural ODEs to fully describe the dynamics of the system and to link the expert and latent variables to observable quantities. We evaluated LHM on synthetic data as well as real-world intensive care data of COVID-19 patients. LHM consistently outperforms previous works, especially when few training samples are available such as at the beginning of the pandemic.
翻译:根据外部刺激模拟系统的时间行为是许多领域的一个基本问题。纯机器学习(ML)方法往往在小型抽样制度中失败,无法提供超出预测的可操作的洞察力。一个大有希望的修改是将专家领域知识纳入ML模型。我们认为,应用是预测药物下疾病的发展过程,从药理学中可以获得大量的领域知识。药理模型描述了从普通差异等分系统(ODs)角度仔细选择的医学上有意义的变量的动态。然而,这些模型只描述有限的变量集合,而这些变量往往在临床环境中无法观察到。为了缩小这一差距,我们提议了一种潜在的混合模型,将专家设计的OD与机学神经值模型结合起来,以充分描述系统的动态,并将专家和潜在变量与可观测的数量联系起来。我们评估了合成数据方面的LHM的动态,以及COVID-19病人的实际密集护理数据。LHM始终超越了以前的工作,特别是当开始出现诸如大流行病的少量培训样品时。