基于多视角结构稀疏表达的自由视角视频合成方法研究

项目名称： 基于多视角结构稀疏表达的自由视角视频合成方法研究

项目编号： No.61472035

项目类型： 面上项目

立项/批准年度： 2015

项目学科： 计算机科学学科

项目作者： 张磊

作者单位： 北京理工大学

项目金额： 80万元

中文摘要： 自由视角视频合成是将有限视角采集的视频数据通过关联和重构生成场景在视场范围内任意新视角下的视频，在视频监控、3D 电视、视频会议等领域有着重要的应用。传统自由视角视频合成方法缺乏视频结构在多视角关联下的有效表达，很难进一步提高场景建模和新视角场景绘制与融合的效率和质量。本项目拟结合计算机图形学、图像与视频处理中的相关理论和算法，利用多视角视频数据的稀疏性作为线索，克服由于多视角关联产生的信息冗余对场景建模和场景绘制与融合的限制，探索基于稀疏性的多视角视频数据的关联组织及高效表示，研究多视角结构的稀疏表达方法，并利用多视角结构研究视频场景建模和新视角场景绘制与融合等关键技术，以进一步提高自由视角视频合成的效率和质量，为多视角视频相关的应用服务提供技术支撑。预期在在国内外重要学术期刊和会议上发表高水平论文10 篇以上，其中国际重要期刊论文6 篇以上，申请专利7 项以上。

中文关键词： 多视角结构；视频合成；自由视角；稀疏表达

英文摘要： Free-view video synthesis is to generate video scene from a novel view in the range of field of view by correlating and reconstructing video data captured from limited views, which has important applications in the fields like video surveillance, 3D television, teleconference. Classic free-view video synthesis methods can not provide efficient representation on video structure with multi-view correlation, thus are difficult to improve the efficiency and quality of scene modeling and rendering and composition. This project plans to integrate the relevant theories and algorithms of computer graphics, image and video processing, and utilize sparsity of multi-view video data as clue that can overcome the limitations on scene modeling and rendering and composition caused by information redundancy in multi-view correlation, and to explore sparsity-based correlation organization and efficient representation on multi-view video data, and to study the method of sparse representation on multi-view structure, and by virtue of multi-view structure to study the key techniques of video scene modeling and novel view scene rendering and composition for further improving efficiency and quality of free-view video synthesis, which can provide technical support for appliation and service based on multi-view videos. Expectation involves over 10 high-quality publications on domestic and international important academic journals and conferences, of which over 6 publications are on interational important journals, and apply over 7 patents.

英文关键词： Multi-view structure;Video synthesis;Free-view;Sparse representation