多用户远程沉浸中的实时三维重建与相关性传输

项目名称： 多用户远程沉浸中的实时三维重建与相关性传输

项目编号： No.61073070

项目类型： 面上项目

立项/批准年度： 2011

项目学科： 金属学与金属工艺

项目作者： 周忠

作者单位： 北京航空航天大学

项目金额： 11万元

中文摘要： 远程沉浸技术实时重建用户三维模型，支持不同地点的用户在同一个共享虚拟环境中进行沉浸式的协同交互，在3D 电视、远程会议、远程指导/训练等领域具有重要的应用前景。 本课题对远程沉浸的两个核心问题-实时三维重建与有效传输开展深入的研究。提出了一种基于深度优化的可视外壳三维重建算法，并利用GPU并行计算技术对重建过程进行加速，在改善可视外壳算法固有的表面精度问题同时，保证了重建过程的实时性；提出了一种高效的纹理压缩方法以支持较高分辨率纹理的使用；提出了一种基于位移残差的数据分发管理服务匹配与传输算法，通过减少不相关数据的发送与接受来降低不必要的网络带宽开销；提出了一种数据备份机制来提高远程沉浸的网络服务质量。基于这些关键技术，本课题建立了多用户远程沉浸系统和四维数据库，并进行了大量实验和应用验证。 课题共发表或已被录用国际期刊或会议论文7篇，其中SCI-E期刊论文3篇，知名国际会议ICTAI、ICN、3DPVT论文各1篇，申请专利2项。课题将核心技术应用到远程沉浸等实时类虚实混合应用中，取得了良好的效果。

中文关键词： 多用户；远程沉浸；实时建模；相关性传输；

英文摘要： Tele-Immersion technology reconstructs user's 3D model in real-time. It enables users in geographically distributed sites to collaborate in a shared virtual environment, so will be promising in such areas as 3D TV, tele-conference and remote learning/training. This project aims at two key problems in tele-immersion field: real-time 3D reconstruction and effective transmission. A depth optimization based visual hall 3D reconstruction algorithm is proposed to improve the inherent surface accuracy problem of the visual hull algorithm. The GPU computing architecture is used to accelerate the procedure of reconstruction, making the algorithm runs in real-time speed. A highly efficient texture compression method is proposed to provide the utilization of high resolution texture. A displacement residual based Data Distribution Management matching and transmission algorithm is proposed to reduce unnecessary network bandwidth cost. An efficient location-aware replication scheme is proposed to improve the quality of tele-immersion network service. Based on the algorithms and technologies proposed, this project has established a multi-user tele-immersion system and a 4D database, and a great deal of experiments and verifications are implemented. During the project, 7 papers are published or accepted in which 3 papers will be published in SCI-E indexed journals, together with 2 items of patent apply. The algorithms and technologies proposed in this project have been applied into such real-time virtual-real mixed application as tele-immersion, which achieves good effect.

英文关键词： Multi-user; Tele-Immersion; Real-Time Modeling; Relevance Transmisson