This paper presents the Accurate Google Cloud Simulator (AGOCS) - a novel high-fidelity Cloud workload simulator based on parsing real workload traces, which can be conveniently used on a desktop machine for day-to-day research. Our simulation is based on real-world workload traces from a Google Cluster with 12.5K nodes, over a period of a calendar month. The framework is able to reveal very precise and detailed parameters of the executed jobs, tasks and nodes as well as to provide actual resource usage statistics. The system has been implemented in Scala language with focus on parallel execution and an easy-to-extend design concept. The paper presents the detailed structural framework for AGOCS and discusses our main design decisions, whilst also suggesting alternative and possibly performance enhancing future approaches. The framework is available via the Open Source GitHub repository.
翻译:本文提出了高精度谷歌云模拟器(AGOCS)——一种基于解析真实工作负载轨迹的新型高保真云工作负载模拟器,可便捷地在桌面计算机上用于日常研究。我们的模拟基于来自一个包含12.5K个节点的谷歌集群、为期一个自然月的真实工作负载轨迹。该框架能够揭示已执行作业、任务及节点的非常精确和详细的参数,并提供实际的资源使用统计。系统采用Scala语言实现,注重并行执行和易于扩展的设计理念。本文详细介绍了AGOCS的结构框架,讨论了主要设计决策,同时提出了未来可能的替代方案及性能优化方向。该框架可通过开源GitHub仓库获取。