基于人类3D视觉感应的2D到3D视频转换关键技术研究

项目名称： 基于人类3D视觉感应的2D到3D视频转换关键技术研究

项目编号： No.61501402

项目类型： 青年科学基金项目

立项/批准年度： 2016

项目学科： 无线电电子学、电信技术

项目作者： 冯杰

作者单位： 浙江理工大学

项目金额： 19万元

中文摘要： 2D到3D转换是解决目前3D视频内容缺乏非常重要的解决方案，同时，如何获得对人类视觉舒适的3D视频仍然是该领域的重点与难点问题。本项目主要研究基于人类3D视觉感应的2D到3D视频转换技术，从分析和理解人类3D视觉感知机理出发，选择和提取3D视觉信息感知特征，建立时空融合的3D视觉感知模型，在模型基础上进行深度图估计并利用时空联合滤波器对其进行处理，然后而利用3D视觉掩蔽效应，对DIBR渲染空洞进行处理，进而得到高质量的3D视频。同时，利用3D视频质量评价体系进行学习并指导3D感应模型中的参数配置，最后将算法应用到现有2D到3D转换软件系统中。本项目的研究成果，能够为制作更加舒适的3D内容提供理论依据和技术方法，对推动我国3D产业的发展具有重要意义。

中文关键词： 二维转三维；人类视觉感应；深度图估计

英文摘要： 2D-to-3D conversion is a very important solution to the lack of 3D contents, meanwhile, how to guarantee the visual comfort of 3D videos is one of the most important and difficult issues in this area. We study 2D-to-3D conversion technology based on human 3D visual perception in this project. By analyzing and understanding the human 3D visual perception mechanism, the 3D visual perception characteristics can be extracted, and the spatio-temporal 3D visual perception model can be created. Then the depth map can be estimated based on the model, and processed by the spatio-temporal filter. Next, the rendered holes generated by DIBR algorithm can be removed according to the 3D visual conjunction effect, and the high quality 3D video will be obtained. At the same time, we use 3D video quality evaluation system to guide the parameter configuration in the 3D visual perception model. Finally these researches will be integrated into the existing 2D-to-3D conversion software system. The results of this research project are able to provide the theoretical basis and technical methods for solving the more visual comfortable 3D video production issues. Its achievements can promote the development of our 3D industry significantly.

英文关键词： 2D-to-3D conversion;human visual perception;depth map estimation