Deep learning models have shown impressive results in a variety of time series forecasting tasks, where modeling the conditional distribution of the future given the past is the essence. However, when this conditional distribution is non-stationary, it poses challenges for these models to learn consistently and to predict accurately. In this work, we propose a new method to model non-stationary conditional distributions over time by clearly decoupling stationary conditional distribution modeling from non-stationary dynamics modeling. Our method is based on a Bayesian dynamic model that can adapt to conditional distribution changes and a deep conditional distribution model that can handle large multivariate time series using a factorized output space. Our experimental results on synthetic and popular public datasets show that our model can adapt to non-stationary time series better than state-of-the-art deep learning solutions.
翻译:深层学习模型在各种时间序列预测任务中显示了令人印象深刻的结果,其中,根据过去对未来有条件分布进行建模是本质。然而,如果这种有条件分布不是静止的,则对这些模型提出了一致学习和准确预测的挑战。在这项工作中,我们提出一种新的方法,通过将固定有条件分布模型与非静止动态模型明确脱钩,来模拟非静止有条件分布长期模式。我们的方法基于一种巴伊西亚动态模型,该模型能够适应有条件分布变化,以及一个能够利用因数化输出空间处理大型多变时间序列的深度有条件分布模型。我们在合成和受欢迎的公共数据集方面的实验结果显示,我们的模型可以比最先进的深层学习解决方案更好地适应非静止时间序列。