数据中心延迟敏感型应用尾端响应时延服务质量保障方法研究

项目名称： 数据中心延迟敏感型应用尾端响应时延服务质量保障方法研究

项目编号： No.61502019

项目类型： 青年科学基金项目

立项/批准年度： 2016

项目学科： 自动化技术、计算机技术

项目作者： 杨海龙

作者单位： 北京航空航天大学

项目金额： 22万元

中文摘要： 数据中心延迟敏感型应用对请求尾端响应时延服务质量有着极其严格的要求，然而请求的大规模并发、多阶段处理和系统状态的动态变化，都对请求处理的响应时延带来不确定性影响，从而对请求尾端响应时延的服务质量保障带来了新的挑战。本课题以延迟敏感型应用请求处理过程为线索，自顶向下依次探索应用层面、运行时层面和体系结构层面的响应时延缓解技术。在应用层面研究延迟感知的请求调配方法，选择满足服务质量要求的节点调度请求，避免节点不匹配严重拖长响应时延；在运行时层面研究面向服务质量的运行时管理机制，在线管控请求对系统资源使用的优先级和速率，缓解负载水平和计算行为变化等因素对响应时延的影响；在体系结构层面研究体系结构自适应的任务调度方法，在满足服务质量要求的基础上发挥不同体系结构特性的优势，改善数据中心的运行效率。同时通过不同层面间响应延迟缓解技术的有机结合，实现尾端响应时延服务质量保障的系统性解决方案。

中文关键词： 数据中心；延迟敏感型应用；尾端时延；服务质量保障

英文摘要： Latency-sensitive applications running on top of datacenter computers require extremely strict QoS guarantee for tail latency responding to user requests. However, the large scale, multiple staged request processing as well as dynamic behaviors of the underlying system have introduced significant amount of variability to the response time per request, which becomes a new challenge to guarantee the QoS of tail latency for datacenter operators. After analyzing the procedure of the request processing, this project proposes a top-down approach regarding the application layer, runtime layer and architecture layer to explore the technologies alleviating the tail latency for latency-sensitive applications. At the application layer, study the methodologies of latency aware request scheduling and resource allocation in order to select the nodes satisfying the QoS requirement, which eliminates the incompatible nodes dragging the tail latency; at the runtime layer, manage the priority and rate of the request accessing the system resources, mitigating the latency fluctuation caused by load and computation phase change; at the architecture layer, study the methodologies of architecture adaptive request scheduling, leveraging the advantages of architecture features to satisfy the QoS of tail latency in addition to improve the efficiency of datacenter system. Moreover, through the combination of latency alleviation technologies from different layers, holistic solutions are derived to guarantee the QoS of tail latency for latency sensitive applications.

英文关键词： datacenter;latency-sensitive application;tail latency;QoS guarantee