基于三维信息单元的高质量虚拟视点绘制技术研究

项目名称： 基于三维信息单元的高质量虚拟视点绘制技术研究

项目编号： No.61472221

项目类型： 面上项目

立项/批准年度： 2015

项目学科： 计算机科学学科

项目作者： 梁秀霞

作者单位： 山东财经大学

项目金额： 82万元

中文摘要： 高质量的虚拟视点绘制技术是推动自由视点视频走向应用的关键。随着数字成像技术的发展，大规模三维场景带来的海量数据和复杂计算对现有虚拟视点绘制技术提出新的挑战。本项目以虚拟视点图像生成的真实感和实时性为目标，通过构造由三维信息单元3DIE描述的物体空间，将虚拟视点绘制问题分解为基于区域采样逆映射过程构建物体空间的3DIE表示和基于物体空间的3DIE表示进行绘制两个子问题。通过提取和表示物体空间的尺度相关特征建立约束条件，构建相应视点下从MVD数据到3DIE表示的特征传递函数，以实现参考图像中的几何结构与纹理特征的完整表示与传递，提高虚拟视点图像的质量。在绘制方面，提出基于局部特征约束的重构核函数，结合GPU的并行体系结构进行绘制，增强算法的实时性。本项目的研究不仅为自由视点视频应用中的虚拟视点生成提供新的理论和方法，还为其他相关领域理论技术的研究提供新的研究方法和思路。

中文关键词： 虚拟视点绘制；三维信息单元；自由视点视频应用；尺度相关；特征传递函数

英文摘要： High-quality free viewpoint generation technology is the key to promote free viewpoint video to application. With the development of digital imaging technology, large-scale three-dimensional scene brings huge amounts of data and complex calculations, which presents new challenges to existing virtual viewpoint generation technologies. This project will research on the key techniques of virtual viewpoint generation aiming to getting real-time and realistic virtual viewpoint image.Three-dimensional object space is established, through which the virtual viewpoint generation problem is decomposed to two parts of the construction of 3DIE and the rendering based 3DIE. By calculating the feature of the object space in best scale to build the representation of scale correlation feature for depth image and RGB image. Thus, Feature transfer function from MVD data to 3DIE is established using the constraints.To improve the quality of virtual viewpoint image, Feature Transfer Function from the MVD data to the 3DIE and adaptive local smoothness constraints are used to optimize the objective presented by 3DIE.In the rendering process, the reconstruction kernel based on local feature constraints, combined with parallel processing architecture of the GPU, is developed to enhance the real-time nature of the algorithm. The research results of this project will provide new theories and methods for the free viewpoint video applications and of great significance to the fundamental theories and techniques upgrading in other related fields.

英文关键词： Virtual View Rendering;3D Information Element;Free View Video Application;Scale Correlation;Feature Transfer Function