It is important to detect changes in software performance during development in order to avoid performance decreasing release to release or dealing with costly delays at release time. Performance testing is part of the development process at MongoDB, and integrated into our continuous integration system. We describe a set of changes to that performance testing environment designed to improve testing effectiveness. These changes help improve coverage, provide faster and more accurate signaling for performance changes, and help us better understand the state of performance. In addition to each component performing better, we believe that we have created and exploited a virtuous cycle: performance test improvements drive impact, which drives more use, which drives further impact and investment in improvements. Overall, MongoDB is getting faster and we avoid shipping major performance regressions to our customers because of this infrastructure.
翻译:必须发现开发过程中软件性能的变化,以避免性能下降,放行,或在放行时处理昂贵的延误。性能测试是MongoDB开发过程的一部分,并被纳入我们的持续整合系统。我们描述一系列旨在提高测试效果的性能测试环境的变化。这些变化有助于扩大覆盖范围,为性能变化提供更快和更加准确的信号,帮助我们更好地了解性能变化。除了每个部分表现得更好外,我们认为我们已经创造并利用了一个良性循环:性能测试改进驱动力影响,这催生了更多的使用,从而催生了进一步的影响和对改进的投资。总体而言,MongoDB正在加快速度,我们避免了由于这一基础设施而给我们的客户带来重大的性能倒退。