This paper reports on a dynamic semantic mapping framework that incorporates 3D scene flow measurements into a closed-form Bayesian inference model. Existence of dynamic objects in the environment can cause artifacts and traces in current mapping algorithms, leading to an inconsistent map posterior. We leverage state-of-the-art semantic segmentation and 3D flow estimation using deep learning to provide measurements for map inference. We develop a Bayesian model that propagates the scene with flow and infers a 3D continuous (i.e., can be queried at arbitrary resolution) semantic occupancy map outperforming its static counterpart. Extensive experiments using publicly available data sets show that the proposed framework improves over its predecessors and input measurements from deep neural networks consistently.
翻译:本文报告一个动态语义图绘制框架,该框架将3D场景流测量纳入一个封闭式贝叶斯推断模型。环境中存在动态物体,在目前的绘图算法中可造成文物和痕迹,导致地图后部不一致。我们利用最先进的语义分解和3D流量估算,利用深层学习为地图推断提供测量。我们开发了一种贝叶西亚模型,以流动方式传播场景,并推断出3D连续(即可以任意解析)语义占用图比静态对应图要好。使用公开的数据集进行的广泛实验表明,拟议框架持续改善了其前身和深层神经网络的投入测量。