Toward Generating Sufficiently Valid Test Case Results: A Method for Systematically Assigning Test Cases to Test Bench Configurations in a Scenario-Based Test Approach for Automated Vehicles

For the market launch of automated vehicles, proof must be provided in advance that they operate safely. However, the problem of how to validate their safe operation remains unsolved. While scenario-based test approaches seem to be possible solutions, they require the execution of a large number of test cases. Several test benches, from actual test vehicles to partly or fully simulated environments, are available to execute these test cases. Each test bench provides different elements, which, in turn, have different parameters and parameter ranges. The composition of elements with their specific parameter values on a specific test bench used to execute a test case is referred to as a test bench configuration. However, selecting the most suitable test bench configuration is challenging. The selected test bench configuration determines whether the execution of a specific test case provides sufficiently valid test case results with respect to the intended purpose, for example, validating a vehicle's safe operation. The effective and efficient execution of a large number of test cases requires a method for systematically assigning test cases to the most suitable test bench configuration. Based on a proposed method for classifying test bench configurations, we propose and illustrate a method for systematically assigning test cases to test bench configurations in a scenario-based test approach for automated vehicles. This assignment method allows the effective and efficient execution of a large number of test cases while generating sufficiently valid test case results.