Context. While in serverless computing, application resource management and operational concerns are generally delegated to the cloud provider, ensuring that serverless applications meet their performance requirements is still a responsibility of the developers. Performance testing is a commonly used performance assessment practice; however, it traditionally requires visibility of the resource environment. Objective. In this study, we investigate whether performance tests of serverless applications are stable, that is, if their results are reproducible, and what implications the serverless paradigm has for performance tests. Method. We conduct a case study where we collect two datasets of performance test results: (a) repetitions of performance tests for varying memory size and load intensities and (b) three repetitions of the same performance test every day for ten months. Results. We find that performance tests of serverless applications are comparatively stable if conducted on the same day. However, we also observe short-term performance variations and frequent long-term performance changes. Conclusion. Performance tests for serverless applications can be stable; however, the serverless model impacts the planning, execution, and analysis of performance tests.
翻译：虽然在无服务器的计算中,应用资源管理和业务问题一般下放给云端提供商,但确保无服务器应用程序满足其性能要求仍然是开发商的责任。性能测试是一种常用的业绩评估做法;然而,它传统上要求资源环境的可见度。 目标。在本研究中,我们调查无服务器应用程序的性能测试是否稳定,也就是说,如果其结果可以复制,以及无服务器模式对性能测试的影响。 方法。我们进行案例研究,收集两套性能测试结果的数据集:(a) 不同内存大小和负荷强度的性能测试重复进行;(b) 每天三次重复同样的性能测试,为期10个月。结果。我们发现,无服务器应用程序的性能测试如果在同一天进行,则相对稳定。然而,我们也观察短期性能变化和频繁的长期性能变化。结论:无服务器应用程序的性能测试可以稳定;然而,无服务器模型影响性能测试的规划、执行和分析。
相关内容
微信扫码咨询专知VIP会员