To develop driving automation technologies for human, a human-centered methodology should be adopted for ensured safety and satisfactory user experience. Automated lane change decision in dense highway traffic is challenging, especially when considering the personalized preferences of different drivers. To fulfill human driver centered decision algorithm development, we carry out driver-in-the-loop experiments on a 6-Degree-of-Freedom driving simulator. Based on the analysis of the lane change data by drivers of three specific styles,personalization indicators are selected to describe the driver preferences in lane change decision. Then a deep reinforcement learning (RL) approach is applied to design human-like agents for automated lane change decision, with refined reward and loss functions to capture the driver preferences.The trained RL agents and benchmark agents are tested in a two-lane highway driving scenario, and by comparing the agents with the specific drivers at the same initial states of lane change, the statistics show that the proposed algorithm can guarantee higher consistency of lane change decision preferences. The driver personalization indicators and the proposed RL-based lane change decision algorithm are promising to contribute in automated lane change system developing.
翻译:为开发人类驾驶自动化技术,应采用以人为中心的方法,确保安全和满足用户的满意经验。在密集高速公路交通中自动更换车道的决定具有挑战性,特别是考虑到不同驾驶员的个人偏好。为了实现以6度自由驾驶模拟器为主的人力驾驶演算法开发,我们进行了在路内驾驶6度自由驾驶模拟器的驾驶实验。根据三种特定型号驾驶员对车道改变数据的分析,选择了个性化指标来描述车道改变决定中的驾驶员偏好。然后采用深度强化学习(RL)方法来设计像人一样的自动更换车道决定,同时完善奖励和损失功能来捕捉驾驶员的偏好。经过培训的RL代理和基准代理商在双线高速公路驾驶假设中进行测试,并通过在车道改变的最初状态上将这些代理商与特定驾驶员进行比较,统计数据表明,拟议的算法可以保证车道改变决定偏好更高的一致性。驾驶员个性化指标和基于RL的拟议车道改变决定算法将有望促进自动车道改变系统的发展。