API economy is driving the digital transformation of business applications across the hybrid Cloud and edge environments. For such transformations to succeed, end-to-end testing of the application API composition is required. Testing of API compositions, even in centralized Cloud environments, is challenging as it requires coverage of functional as well as reliability requirements. The combinatorial space of scenarios is huge, e.g., API input parameters, order of API execution, and network faults. Hybrid Cloud and edge environments exacerbate the challenge of API testing due to the need to coordinate test execution across dynamic wide-area networks, possibly across network boundaries. To handle this challenge, we envision a test framework named Distributed Software Test Kit (DSTK). The DSTK leverages Combinatorial Test Design (CTD) to cover the functional requirements and then automatically covers the reliability requirements via under-the-hood closed loop between test execution feedback and AI based search algorithms. In each iteration of the closed loop, the search algorithms generate more reliability test scenarios to be executed next. Specifically, five kinds of reliability tests are envisioned: out-of-order execution of APIs, network delays and faults, API performance and throughput, changes in API call graph patterns, and changes in application topology.
翻译:API经济正在推动跨越混合云层和边缘环境的商业应用数字转换。这种转换要成功,就必须对API构成进行端到端的测试。 即使在中央云层环境中,对API构成的测试也具有挑战性,因为它需要涵盖功能和可靠性要求。 情景组合空间巨大,例如API输入参数、API执行命令和网络故障。 混合云和边缘环境加剧了API测试的挑战,因为需要协调动态广域网络(可能跨网络边界)的测试执行。 为了应对这一挑战,我们设想了一个名为分布软件测试工具包(DSTK)的测试框架。 DSTK 组合测试设计(CTD) 覆盖功能要求,然后自动覆盖通过测试执行反馈和基于AI的搜索算法之间的闭合周期内的可靠性要求。 在闭环的每次循环中,搜索算法产生更多的可靠性测试情景,下一步将执行。 具体地说,设想了五种可靠性测试: API 的分级执行、 API 和图表应用中的顶级变化、 API 、 顶级运行模式和错误应用。