In a cyber-physical system such as an autonomous vehicle (AV), machine learning (ML) models can be used to navigate and identify objects that may interfere with the vehicle's operation. However, ML models are unlikely to make accurate decisions when presented with data outside their training distribution. Out-of-distribution (OOD) detection can act as a safety monitor for ML models by identifying such samples at run time. However, in safety critical systems like AVs, OOD detection needs to satisfy real-time constraints in addition to functional requirements. In this demonstration, we use a mobile robot as a surrogate for an AV and use an OOD detector to identify potentially hazardous samples. The robot navigates a miniature town using image data and a YOLO object detection network. We show that our OOD detector is capable of identifying OOD images in real-time on an embedded platform concurrently performing object detection and lane following. We also show that it can be used to successfully stop the vehicle in the presence of unknown, novel samples.
翻译:在诸如自动飞行器(AV)等网络物理系统中,机器学习(ML)模型可用于导航和识别可能干扰飞行器运行的物体。然而,如果ML模型提供其培训分布之外的数据,则不可能作出准确的决定。超出分布(OOOD)检测可以实时识别此类样品,作为ML模型的安全监测器。但在诸如AVs等安全临界系统中,OOD检测除了功能要求外,还需要满足实时限制。在这次演示中,我们使用移动机器人作为AV的代孕,并使用OOOD探测器识别潜在的危险样品。机器人利用图像数据和YOLO天体探测网络浏览一个微型城镇。我们显示,我们的OOOD探测器能够实时在嵌入平台上识别OOD图像,同时进行物体探测和跟踪。我们还表明,在未知的新样本出现的情况下,可以使用移动机器人成功拦截该车辆。