Serverless computing has become a new cloud computing paradigm that promises to deliver high cost-efficiency and simplified cloud deployment with automated resource scaling at a fine granularity. Users decouple a cloud application into chained functions and preset each serverless function's memory and CPU demands at megabyte-level and core-level, respectively. Serverless platforms then automatically scale the number of functions to accommodate the workloads. However, the complexities of chained functions make it non-trivial to accurately determine the resource demands of each function for users, leading to either resource over-provision or under-provision for individual functions. This paper presents FaaSRM, a new resource manager (RM) for serverless platforms that maximizes resource efficiency by dynamically harvesting idle resources from functions over-supplied to functions under-supplied. FaaSRM monitors each function's resource utilization in real-time, detects over-provisioning and under-provisioning, and applies deep reinforcement learning to harvest idle resources safely using a safeguard mechanism and accelerate functions efficiently. We have implemented and deployed a FaaSRM prototype in a 13-node Apache OpenWhisk cluster. Experimental results on the OpenWhisk cluster show that FaaSRM reduces the execution time of 98% of function invocations by 35.81% compared to the baseline RMs by harvesting idle resources from 38.8% of the invocations and accelerating 39.2% of the invocations.
翻译:无服务器计算已成为一个新的云计算模式,有望在微粒度下提供高成本效率和简化云度部署,实现高成本效率和简化云度部署,并实现自动资源缩放。用户将云的应用程序分解为链式功能,并预设每个无服务器功能的记忆和CPU需求,在兆字节和核心级别分别达到。没有服务器的平台随后自动扩大功能数量,以适应工作量。然而,由于链锁功能的复杂性,无法准确确定每个功能对用户的资源需求,导致资源过多或单个功能的配置不足。本文展示了无服务器平台的新资源管理员FaaaSRM,这是一个新的资源管理员(RMM),该平台通过动态收集从过度配置的功能中闲置资源,实现资源效率最大化。无服务器平台FaSRM监测每个功能的实时利用率,检测过度供给和供给不足,并运用深度强化学习,利用保障机制安全获取闲置资源,并高效地加快功能。我们实施并部署了FaaSRM原型(Faa-node Astarima)的13nde OS OpenWhal8,通过加速实施98Wsal Basalalal 的 Rasimalal 将自动测试结果,通过加速进行为98-hal-hassal-hal-hassal-hassalemembalalalalalembalembal-hal-halbalbalbalbal ASalal 将显示98-hal basal AS结果。