Remote Monitoring and Teleoperation of Autonomous Vehicles -- Is Virtual Reality an Option?

While the promise of autonomous vehicles has led to significant scientific and industrial progress, fully automated, SAE level 5 conform cars will likely not see mass adoption anytime soon. Instead, in many applications, human supervision, such as remote monitoring and teleoperation, will be required for the foreseeable future. While Virtual Reality (VR) has been proposed as one potential interface for teleoperation, its benefits and drawbacks over physical monitoring and teleoperation solutions have not been thoroughly investigated. To this end, we contribute two user studies, comparing the performance of and subjective feedback for a VR-based system with an existing monitoring and teleoperation system, which is in industrial use today. The results of our first user study (n=16), indicate that a VR interface replicating the physical interface does not outperform the physical interface. It also quantifies the negative effects that combined monitoring and teleoperating tasks have on users irrespectively of the interface being used. The results of the second user study (n=24), indicate that the perceptual and ergonomic issues caused by VR outweigh its benefits like better concentration through isolation, which is critical for monitoring tasks. Through these two user studies, we contribute to a better understanding of future virtual monitoring and teleoperation solutions for autonomous vehicles.