社会化视频语义分析关键技术研究

项目名称： 社会化视频语义分析关键技术研究

项目编号： No.61472392

项目类型： 面上项目

立项/批准年度： 2015

项目学科： 计算机科学学科

项目作者： 查正军

作者单位： 中国科学院合肥物质科学研究院

项目金额： 81万元

中文摘要： 社会网络的兴起和视频采集设备的普及催生了社会化视频数据，其规模呈爆炸式增长。高效的社会化视频语义分析技术成为迫切需求。然而传统的视频分析技术无法有效地分析模式复杂、内容多样的社会化视频数据。本课题致力于研究社会化视频语义分析中的关键技术。拟通过社会标签收集多来源网络媒体数据，对数据进行清洗去噪，为语义概念建模构建高质量的样本集；在此基础上，综合利用多源样本以及多模态特征建立高性能的语义概念模型；进而深入挖掘社会化视频的社会上下文信息，合理融合上下文信息对视频的语义分析结果进行优化；并引入人机交互，提出结合社会化视频数据特性的主动学习方法，对语义概念模型进行更新和完善。本课题将有力推动视频分析理论和应用的发展，为新一代视频服务与管理提供核心算法和技术。

中文关键词： 社会化视频；视频语义分析；视频检索

英文摘要： The rapid advances of social network and video capture devices have spawned social video. We have witnessed an explosive growth of social video in recent years. Effective techniques for analyzing social videos are highly desired. However, conventional video analysis techniques cannot well analyze social video data, which contains complicated patterns and diverse content. In this proposal, we target to address the key issues in social video semantic analysis and propose an effective solution. We first propose to construct a high-quality training set, which is used for learning semantic concepts, by leveraging social tags. The media entities, such as images and video clips, are collected through their associated social tags from multiple Web sites. The collected entities are then denoised to form the training set, based on which, we propose to build the models of semantic concepts by simultaneously using multi-source samples and multi-modality features. The models are in turn used to infer the semantic of social videos. We then propose to mine the social context of videos and use social context to help optimize the semantic analysis results. We also propose to incorporate human interaction into social video semantic analysis. An active learning approach is developed to refine the models of semantic concepts. The approach takes into account the properties of social video data. Our research will surely make an important advance in the theories and applications of video analysis and it will play an important role in next-generation video management and service technologies.

英文关键词： Social video;Video Semantic Analysis;Video Retrieval