We explore object discovery and detector adaptation based on unlabeled video sequences captured from a mobile platform. We propose a fully automatic approach for object mining from video which builds upon a generic object tracking approach. By applying this method to three large video datasets from autonomous driving and mobile robotics scenarios, we demonstrate its robustness and generality. Based on the object mining results, we propose a novel approach for unsupervised object discovery by appearance-based clustering. We show that this approach successfully discovers interesting objects relevant to driving scenarios. In addition, we perform self-supervised detector adaptation in order to improve detection performance on the KITTI dataset for existing categories. Our approach has direct relevance for enabling large-scale object learning for autonomous driving.
翻译:我们探索基于从移动平台获取的未贴标签视频序列的物体发现和探测器适应。 我们建议完全自动地从视频中进行物体开采,该方法以通用物体跟踪方法为基础。 通过将这种方法应用于自主驾驶和移动机器人情景的三个大型视频数据集,我们展示了该方法的稳健性和普遍性。 根据物体开采结果,我们提出了一种新颖的方法,通过外观集群进行不受监督的物体发现。我们表明,该方法成功地发现了与驾驶情景相关的有趣物体。此外,我们还进行了自我监督的探测器改造,以改进现有类别KITTI数据集的探测性能。我们的方法对于使大型物体学习用于自主驾驶具有直接相关性。