Testing and evaluation is a crucial step in the development and deployment of Connected and Automated Vehicles (CAVs). To comprehensively evaluate the performance of CAVs, it is of necessity to test the CAVs in safety-critical scenarios, which rarely happen in naturalistic driving environment. Therefore, how to purposely and systematically generate these corner cases becomes an important problem. Most existing studies focus on generating adversarial examples for perception systems of CAVs, whereas limited efforts have been put on the decision-making systems, which is the highlight of this paper. As the CAVs need to interact with numerous background vehicles (BVs) for a long duration, variables that define the corner cases are usually high dimensional, which makes the generation a challenging problem. In this paper, a unified framework is proposed to generate corner cases for the decision-making systems. To address the challenge brought by high dimensionality, the driving environment is formulated based on Markov Decision Process, and the deep reinforcement learning techniques are applied to learn the behavior policy of BVs. With the learned policy, BVs will behave and interact with the CAVs more aggressively, resulting in more corner cases. To further analyze the generated corner cases, the techniques of feature extraction and clustering are utilized. By selecting representative cases of each cluster and outliers, the valuable corner cases can be identified from all generated corner cases. Simulation results of a highway driving environment show that the proposed methods can effectively generate and identify the valuable corner cases.
翻译:在开发和部署连接和自动化车辆(CAVs)方面,测试和评价是开发和部署连接和自动化车辆(CAVs)的关键步骤。为了全面评价CAV的性能,有必要对安全临界情况下的CAV进行测试,这在自然驱动环境中很少发生。因此,如何有目的和系统地生成这些角落案例是一个重要问题。大多数现有研究侧重于为CAV的认知系统生成对抗性实例,而本文突出的则是决策系统。由于CAVs需要与许多背景车辆(BVs)长期互动,因此确定角落案例的变量通常是高维度的,这就使得形成一个具有挑战性的问题。因此,在本文件中,提议了一个统一框架,为决策系统生成角落案例。为了应对高视野带来的挑战,驱动环境的驱动环境是根据Markov决定程序制定的,并且运用深度强化学习技术来学习BVs的拟议行为政策。随着所学习的政策,BVs将行为和与CAVs进行更激烈的互动,从而导致这一角落案例的产生一个具有挑战性的问题。在本文件中,进一步分析每个角落生成的角落环境案例,然后分析所生成的角落案例。