In this document, we describe LDBC Graphalytics, an industrial-grade benchmark for graph analysis platforms. The main goal of Graphalytics is to enable the fair and objective comparison of graph analysis platforms. Due to the diversity of bottlenecks and performance issues such platforms need to address, Graphalytics consists of a set of selected deterministic algorithms for full-graph analysis, standard graph datasets, synthetic dataset generators, and reference output for validation purposes. Its test harness produces deep metrics that quantify multiple kinds of systems scalability, weak and strong, and robustness, such as failures and performance variability. The benchmark also balances comprehensiveness with runtime necessary to obtain the deep metrics. The benchmark comes with open-source software for generating performance data, for validating algorithm results, for monitoring and sharing performance data, and for obtaining the final benchmark result as a standard performance report.
翻译:在本文中,我们介绍了LDBC Graphalytics——一种用于图分析平台的工业级基准测试。Graphalytics的主要目标是实现公正客观地比较图分析平台的性能。由于这种平台需要解决的瓶颈和性能问题的多样性,Graphalytics包含了一组所选拔的确定性算法、标准图数据集、合成数据集生成器和用于验证的参考输出。它的测试套件生成可量化多种系统可扩展性(包括弱与强可扩展性)和健壮性指标,如失败和性能变异等深入指标。该基准测试还在平衡全面性与获得深入指标所需的运行时间之间进行了权衡。基准测试配备有用于生成性能数据、验证算法结果、监视与共享性能数据以及获得标准性能报告的开源软件。