基于多载体协同跟随的多视角三维场景下人群异常事件检测方法研究

项目名称： 基于多载体协同跟随的多视角三维场景下人群异常事件检测方法研究

项目编号： No.61473277

项目类型： 面上项目

立项/批准年度： 2015

项目学科： 自动化技术、计算机技术

项目作者： 吴新宇

作者单位： 中国科学院深圳先进技术研究院

项目金额： 83万元

中文摘要： 对公共场所的密集人群进行视频监控是预防人群灾难，减少各种突发性事件，保障人民群众生命财产安全的重要手段。传统的基于固定单摄像机的智能视频监控系统由于位置和视角的限制，难以实现对大跨度场景的实时监控，更无法主动跟随监控目标进行连续追踪，从而影响监控的效果和效率。我们结合移动机器人技术和智能视频分析技术，提出基于多载体协同跟随实现多视角三维场景下的人群异常事件检测，通过融合固定摄像机及搭载在多载体（飞行机器人、地面移动机器人）上的移动摄像机的视频信息，不仅能对大跨度场景进行全覆盖式的实时监控，还能持续地追踪感兴趣的目标并进行异常行为检测。本项目研究内容包括：基于多载体自身GPS信息及全局多特征图的三维场景实时重建；多载体协同的目标主动追随；三维场景下对全局、局部及个体异常行为进行检测。项目研究成果能为各类人群异常事件提供早期预警和分析手段，对加强城市管理和保障公共安全具有重要的实用价值。

中文关键词： 视频监控；异常检测；多载体；协同跟随；三维场景重建

英文摘要： Visual surveillance on the crowds in public places is the important means for preventing crowd disaster, diminishing all sorts of breaking events, ensuring safety of people and their properties. The classical intelligent video surveillance system based on single camera with fixed-position, however, limited by the position and viewing angle, is incapable of making real-time surveillance to large span zone, not to mention the active and continuous tracking on the object under surveillance, which greatly reduce the effect and efficiency of visual surveillance. In this proposal, based on the technology of mobile robot and intelligent video analysis, anomaly detection in crowd is investigated by the cooperative following behaviors of multiple carriers in 3D real scenes under different viewing angle. By combining video information obtained from the cameras mounted on fixed places with those on multiple carriers including flying robot, land robot, etc., We can not only realize real-time surveillance to large span zone with full-coverage, but also continuously track the object of interest and detect crowd anomaly as well. Our research topics include the following. First of all, real-time 3D scene is reconstructed based on the GPS information of multiple carriers and the global feature maps. Secondly,active object tracing based on collabration of multiple carriers.Thirdly, Abnormal behaviors of individuals in global or local zone are detected under 3D scene. It's expected the results of this research can facilitate early warning and analysis on crowd anomalies, which is of great practical use in reinforcing management in cities as well as maintaining public security.

英文关键词： Video surveillance;Anomalies detection;Multiple carriers;Cooprative Following;3D scene reconstruction