Anomaly detection is a branch of machine learning and data analysis which aims at identifying observations that exhibit abnormal behaviour. Be it measurement errors, disease development, severe weather, production quality default(s) (items) or failed equipment, financial frauds or crisis events, their on-time identification, isolation and explanation constitute an important task in almost any branch of industry and science. By providing a robust ordering, data depth -- statistical function that measures belongingness of any point of the space to a data set -- becomes a particularly useful tool for detection of anomalies. Already known for its theoretical properties, data depth has undergone substantial computational developments in the last decade and particularly recent years, which has made it applicable for contemporary-sized problems of data analysis and machine learning. In this article, data depth is studied as an efficient anomaly detection tool, assigning abnormality labels to observations with lower depth values, in a multivariate setting. Practical questions of necessity and reasonability of invariances and shape of the depth function, its robustness and computational complexity, choice of the threshold are discussed. Illustrations include use-cases that underline advantageous behaviour of data depth in various settings.
翻译:异常探测是机器学习和数据分析的一个分支,目的是查明显示异常行为的观测结果。无论是测量错误、疾病开发、恶劣天气、生产质量违约(项目)或故障设备、金融欺诈或危机事件,其实时识别、孤立和解释几乎是任何工业和科学部门的一项重要任务。通过提供强有力的订购、数据深度 -- -- 统计功能,测量空间中任何一点对数据集的归属性 -- -- 成为发现异常现象的一个特别有用的工具。数据深度已经因其理论特性而为人所知,过去十年,特别是近些年来,经历了大量的计算发展,使数据质量违约(项目)或故障设备、金融欺诈或危机事件都适用于当代规模的问题。在本篇文章中,对数据深度进行了研究,将其作为一种高效的异常探测工具,在多变环境中为较低深度的观察划定异常标签。讨论了深度函数的必要性和形状、稳健性和计算复杂性、阈值的选择等实际问题。说明包括强调不同环境中数据深度的有利行为的使用案例。