Early fault detection and fault prognosis are crucial to ensure efficient and safe operations of complex engineering systems such as the Spallation Neutron Source (SNS) and its power electronics (high voltage converter modulators). Following an advanced experimental facility setup that mimics SNS operating conditions, the authors successfully conducted 21 fault prognosis experiments, where fault precursors are introduced in the system to a degree enough to cause degradation in the waveform signals, but not enough to reach a real fault. Nine different machine learning techniques based on ensemble trees, convolutional neural networks, support vector machines, and hierarchical voting ensembles are proposed to detect the fault precursors. Although all 9 models have shown a perfect and identical performance during the training and testing phase, the performance of most models has decreased in the prognosis phase once they got exposed to real-world data from the 21 experiments. The hierarchical voting ensemble, which features multiple layers of diverse models, maintains a distinguished performance in early detection of the fault precursors with 95% success rate (20/21 tests), followed by adaboost and extremely randomized trees with 52% and 48% success rates, respectively. The support vector machine models were the worst with only 24% success rate (5/21 tests). The study concluded that a successful implementation of machine learning in the SNS or particle accelerator power systems would require a major upgrade in the controller and the data acquisition system to facilitate streaming and handling big data for the machine learning models. In addition, this study shows that the best performing models were diverse and based on the ensemble concept to reduce the bias and hyperparameter sensitivity of individual models.
翻译:早期错误检测和错误预测对于确保复杂的工程系统,例如“Spallation Enecontron Source”(SNS)及其电动电子系统(高电转换器调制器)高效和安全运行至关重要。在模拟SNS运行条件的先进实验设施安装后,作者成功进行了21次错误预测实验,在系统中引入了足以导致波形信号退化的缺陷前体,但不足以达到真正的缺陷。9种基于混合灵敏树、革命神经网络、支持矢量机和等级投票团等复杂工程系统的机器学习技术被提议用于检测故障前体。尽管所有9种模型在培训和测试阶段都表现出完美和相同的性能,但大多数模型在预测阶段的性能已经下降,一旦他们接触到21项实验中的真实世界数据,就足以导致波形信号的退化,但不足以达到真正的缺陷。分级投票团在早期检测断层前体(95%的成功率为20/21次测试)中保持了显著的性能,随后又提出“最差”和极差的机极性电流模型,在培训和测试阶段中,运行了52%和48%的数据成功率测试。