Software and System logs record runtime information about processes executing within a system. These logs have become the most critical and ubiquitous forms of observability data that help developers understand system behavior, monitor system health and resolve issues. However, the volume of logs generated can be humongous (of the order of petabytes per day) especially for complex distributed systems, such as cloud, search engine, social media, etc. This has propelled a lot of research on developing AI-based log based analytics and intelligence solutions that can process huge volume of raw logs and generate insights. In order to enable users to perform multiple types of AI-based log analysis tasks in a uniform manner, we introduce LogAI (https://github.com/salesforce/logai), a one-stop open source library for log analytics and intelligence. LogAI supports tasks such as log summarization, log clustering and log anomaly detection. It adopts the OpenTelemetry data model, to enable compatibility with different log management platforms. LogAI provides a unified model interface and provides popular time-series, statistical learning and deep learning models. Alongside this, LogAI also provides an out-of-the-box GUI for users to conduct interactive analysis. With LogAI, we can also easily benchmark popular deep learning algorithms for log anomaly detection without putting in redundant effort to process the logs. We have opensourced LogAI to cater to a wide range of applications benefiting both academic research and industrial prototyping.
翻译:软件和系统日志记录系统运行过程的运行时间信息。 这些日志已成为最关键和普遍的观察数据形式, 帮助开发者理解系统行为、 监测系统健康和解决问题。 然而, 生成的日志数量可以是多式的( 每天花生蜂鸟的顺序), 特别是对于云、 搜索引擎、 社交媒体等复杂分布的系统而言。 这推动了大量关于开发基于AI的日志分析和情报解决方案的研究, 可以处理大量原始日志并产生洞察力。 为了让用户能够以统一的方式执行多种基于AI的日志分析任务, 我们引入了LogAI(https://github.com/salesforce/logai), 是一个用于记录分析和智能的一站式开放源库库。 LogAI 支持诸如日志对齐、 日志组合和日志异常检测等任务。 它采用OpenTerealTehoal 数据模型, 以便能够与不同的日志管理平台兼容。 LogalAI提供统一的模型界面, 并且提供流行的时间序列、 统计学习和深层次的系统 ASlobal- logingalal laisal Areal Areal ex laisal exalal ex laisalalalal exalalalal exal laction licommaisal deal licommaisalalalal deal deal deal deal deal deal deal deal deal deal deal deal deal deal deal deal deal sal deal deal deal deal deal decumental deald ladess 。我们提供一种为我们提供一种学习模型。