基于空间感知的混合现实徒手自然交互技术研究

项目名称： 基于空间感知的混合现实徒手自然交互技术研究

项目编号： No.61272299

项目类型： 面上项目

立项/批准年度： 2013

项目学科： 自动化技术、计算机技术

项目作者： 万华根

作者单位： 浙江大学

项目金额： 81万元

中文摘要： 混合现实作为一种新兴的三维用户界面形式，引起了研究人员的极大关注。徒手自然交互作为其中的制高点，为许多应用领域所亟需。本项目以用户对混合现实环境的空间感知为切入点，以徒手交互运动的实时捕获和用户交互意图的理解为研究核心，对混合现实徒手自然交互的用户需求分析与可用性/用户体验评估及交互空间建模、增强用户空间感知的虚实融合绘制方法、复杂背景下的人手分割及鲁棒的实时运动跟踪、徒手自然交互动作的表示及用户意图识别等问题展开深入研究，力争突破混合现实徒手自然交互中的关键技术，将真实人手这一天然的"实物工具"引入混合现实环境，实现人与现实-虚拟连续体的直观、自然、和谐的交互。

中文关键词： 虚拟现实；混合现实；三维交互；徒手交互；虚实融合绘制

英文摘要： Mixed reality as a new form of three-dimensional user interface, has attracted great concern in research community. Bare hand natural interaction as one of the highest points, is an urgent need for many application areas. This project addresses bare hand natural interaction techniques in mixed reality environments, with the user's spatial perception of mixed reality environments as a starting point, and the real-time capture of user interactions and the understanding of user intentions as the core. The main research contents include requirement analysis, usability/user experience evaluation, and interaction space modeling for bare hand natural interactions in mixed reality environments, mixed reality rendering techniques to enhance the user's spatial perception, bare hand segmentation in complex backgrounds and robust real-time bare hand tracking, and representation of the user's actions and recognition of the user's intentions. The final goal of the project is to introduce the bare hands as natural 'physical tools' into mixed reality environments to realize intuitive, natural, and resonant interactions with the reality-virtuality continuum.

英文关键词： Virtual Reality；Mixed Reality；3D Interaction；Bare Hand Interaction；Mixed Reality Rendering