Event cameras are novel bio-inspired sensors that offer advantages over traditional cameras (low latency, high dynamic range, low power, etc.). Optical flow estimation methods that work on packets of events trade off speed for accuracy, while event-by-event (incremental) methods have strong assumptions and have not been tested on common benchmarks that quantify progress in the field. Towards applications on resource-constrained devices, it is important to develop optical flow algorithms that are fast, light-weight and accurate. This work leverages insights from neuroscience, and proposes a novel optical flow estimation scheme based on triplet matching. The experiments on publicly available benchmarks demonstrate its capability to handle complex scenes with comparable results as prior packet-based algorithms. In addition, the proposed method achieves the fastest execution time (> 10 kHz) on standard CPUs as it requires only three events in estimation. We hope that our research opens the door to real-time, incremental motion estimation methods and applications in real-world scenarios.
翻译:活动摄像机是新颖的生物激励感应器,比传统摄像机(低延迟、高动态范围、低功率等)更具有优势。 光流估计法,在事件包上工作,使事件速度与准确性互换,而事件(强化)方法则有很强的假设,没有根据共同基准进行测试,以量化实地的进展。在对资源限制装置的应用方面,开发快速、轻量和准确的光学流动算法非常重要。这项工作利用神经科学的洞察力,并提出了基于三重匹配的新光学流量估计方案。关于公开基准的实验表明,它有能力处理复杂场景,其结果与先前的基于包的算法相似。此外,拟议方法在标准CPU上实现最快的执行时间( > 10千赫兹),因为它只需要三次估计。我们希望我们的研究为现实世界情景中的实时、递增运动估计方法和应用打开大门。