Recently, there has been a significant amount of interest in satellite telemetry anomaly detection (AD) using neural networks (NN). For AD purposes, the current approaches focus on either forecasting or reconstruction of the time series, and they cannot measure the level of reliability or the probability of correct detection. Although the Bayesian neural network (BNN)-based approaches are well known for time series uncertainty estimation, they are computationally intractable. In this paper, we present a tractable approximation for BNN based on the Monte Carlo (MC) dropout method for capturing the uncertainty in the satellite telemetry time series, without sacrificing accuracy. For time series forecasting, we employ an NN, which consists of several Long Short-Term Memory (LSTM) layers followed by various dense layers. We employ the MC dropout inside each LSTM layer and before the dense layers for uncertainty estimation. With the proposed uncertainty region and by utilizing a post-processing filter, we can effectively capture the anomaly points. Numerical results show that our proposed time series AD approach outperforms the existing methods from both prediction accuracy and AD perspectives.
翻译:最近,人们对利用神经网络(NN)进行卫星遥测异常探测(AD)的兴趣很大。就AD而言,目前的方法侧重于预测或时间序列的重建,无法测量可靠性或正确探测的概率。虽然以巴伊西亚神经网络(BNN)为基础的方法在时间序列估计方面广为人知,但它们在计算上是难以理解的。在本文中,我们根据蒙特卡洛(MC)的退出方法,为BNN提出了一个可移动近似值,以捕捉卫星遥测时间序列中的不确定性,同时又不牺牲准确性。就时间序列预测而言,我们采用了由若干长期短期内存层组成的NNNP,然后是各种密集的层。我们在每个LSTM层和密度层之前都采用MC的辍学来估计不确定性。随着拟议的不确定性区域并利用后处理过滤器,我们可以有效地捕捉异常点。数字结果显示,我们所提议的时间序列的AD方法从预测准确性和反倾销的角度超越了现有方法。