We introduce a novel way to combine boosting with Gaussian process and mixed effects models. This allows for relaxing, first, the linearity assumption for the mean function in Gaussian process and grouped random effects models in a flexible non-parametric way and, second, the independence assumption made in most boosting algorithms. The former is advantageous for predictive accuracy and for avoiding model misspecifications. The latter is important for more efficient learning of the mean function and for obtaining probabilistic predictions. In addition, we present an extension that scales to large data using a Vecchia approximation for the Gaussian process model relying on novel results for covariance parameter inference. We obtain increased predictive accuracy compared to existing approaches on several simulated and real-world data sets.
翻译:我们引入了一种与高斯进程和混合效应模型相结合的新型提振与高斯进程和混合效应模型相结合的方法。这首先可以放松高斯进程平均功能的线性假设和以灵活的非参数方式对随机效应模型进行分组,其次可以放松在大多数提振算法中所作的独立假设。前者有利于预测准确性和避免模型的偏差。后者对于更有效地了解中值功能和获得概率预测非常重要。此外,我们利用高斯进程模型的Vecchia近似值来将大数据扩展为大型数据,依靠新的结果来推断共变参数。我们获得的预测准确性比一些模拟和现实世界数据集的现有方法要高。