面向交互式移动图形的低延时低代价混合远程绘制技术研究

项目名称： 面向交互式移动图形的低延时低代价混合远程绘制技术研究

项目编号： No.61472363

项目类型： 面上项目

立项/批准年度： 2015

项目学科： 计算机科学学科

项目作者： 杨柏林

作者单位： 浙江工商大学

项目金额： 79万元

中文摘要： 智能移动设备的普及和3G/4G移动网络的逐步推广推动了三维移动图形应用的快速发展。本课题主要针对移动设备的功耗供给受限、性能较低以及移动网络窄带宽、高时延缺陷，在已有的图形编码和传输协议设计研究成果基础上，进一步探索移动设备上三维图形的低代价低延时同时具有真实感的交互式混合远程绘制方法，主要包括：以实现真实感交互式绘制为目标，研究基于自适应谱图几何图像的三维模型交互式绘制算法；以减少交互式传输时延为目标，研究基于多深度图的三维图形低延迟远程绘制与压缩算法；融合上述两种方法，研究一种面向移动设备的复杂三维场景低代价混合绘制方法。力争在基于谱图小波变换的自适应多分辨率几何图像构建、动态交互式绘制；多深度图压缩、快速参考视点选择；三维场景显著性对象区分、联合信源信道图像位分配和节能颜色优化模型等关键技术的研究上取得突破，为实现移动网络环境下三维图形的低代价交互式实时绘制提供新的研究方法和思路。

中文关键词： 虚拟现实；可视化；多媒体技术；人机交互

英文摘要： With the widespread of 3G/4G WAN and the intelligent mobile device, 3D mobile graphics applications have been gotten a rapid development recently. In order to overcome the the limitations of low power consumption and low computing performance for mobile device and the shortcomings of short bandwidth and high latency for the wireless network, this project mainly discusses the method of low cost and low latency hybrid remote rendering for interactive mobile graphics based on our existed researches of the mobile graphics encoding and transmission protocol. In detail, major achievements this project hopes to obtain are the following: 3D model interactive rendering method based on the adaptive spectral graph geometry image; Low latencey remote rendeirng and compression algorithm based on multi-depth images; Low cost hybrid rendering methods for complicated 3D scene on mobile device. Through above investigations, we hope we can solve the following key technologies including adaptive multiresoluation spectral graph geometry image construction, dynamical interactive rendering, multi-depth images compression, quick reference view choosen, visual salient object detection, joint source and channel bit allication for scene image and energy-saving color set optimization model. It can be seen that this project would provide novel methods and basic principles for 3D model low latency and low cost hybrid interactive rendering on the mobile device and thus improve or develop both theory and methodology for the research field of mobile graphics computing.

英文关键词： Virutal Reality;Visulization;Multimedia;Computer Human Interaction