Over 600,000 bridges in the U.S. must be inspected every two years to identify flaws, defects, or potential problems that may need follow-up maintenance. An aerial robotic technology, Unmanned Aerial Vehicles (drones), has been adopted for bridge inspection for improving safety, efficiency, and cost-effectiveness. Although drones have an autonomous operation mode, keeping inspectors in the loop is still necessary for complex tasks like bridge inspection. Therefore, inspectors need to develop the skill and confidence in operating drones in their jobs. This paper presents the design and development of a virtual reality-based system for training inspectors who are assisted by a drone in the bridge inspection. The system is composed of four integrated modules: a simulated bridge inspection developed in Unity, an interface that allows a trainee to operate the drone in simulation using a remote controller, monitoring and analysis that analyzes data to provide real-time, in-task feedback to trainees to assist their learning, and a post-study assessment for accelerating the learning of trainees. The paper also conducts a small-size experimental study to illustrate the functionality of this system and its helpfulness for establishing the inspector-drone partnership. The developed system has built a modeling and analysis foundation for exploring advanced solutions to human-drone cooperative inspection and human sensor-based human-drone interaction.
翻译:美国60多万座桥梁必须每两年检查一次,以查明可能需要后续维修的缺陷、缺陷或潜在问题。一个空中机器人技术,即无人驾驶航空飞行器(无人驾驶飞行器)已经采用,用于桥检,以提高安全、效率和成本效益。虽然无人驾驶飞机具有自主操作模式,但仍需要将检查员留在环形圈中,以完成桥梁检查等复杂任务。因此,检查员需要发展在其工作中操作无人驾驶飞机的技能和信心。本文件介绍设计和开发一个虚拟的现实化系统,用于培训在桥检中得到无人驾驶飞机协助的视察员。该系统由四个综合模块组成:在联合公司开发的模拟桥检,使受训人员能够使用远程控制器进行模拟操作无人驾驶飞机,监测和分析数据,为学员提供实时、任务内反馈,协助学员学习,并进行研究后评估,以加快学员学习。本文件还进行了小规模的实验研究,以说明该系统的功能及其对于建立视察员-机合作关系的先进解决办法的帮助。发达的系统为人类传感器的模拟和人类传感器视察和研究基础。