手势驱动的直接操纵3D人机自然交互界面中的透明性模型和算法研究

项目名称： 手势驱动的直接操纵3D人机自然交互界面中的透明性模型和算法研究

项目编号： No.61472163

项目类型： 面上项目

立项/批准年度： 2015

项目学科： 计算机科学学科

项目作者： 冯志全

作者单位： 济南大学

项目金额： 84万元

中文摘要： 针对手势驱动的直接操纵3D人机交互界面中的伪自然性问题，从理论模型、技术方法到应用原型三个层次，从虚拟界面的透明性、三空间之间映射关系的透明性、透明性迎合等三个层面进行原创性研究，进而揭示基于虚拟界面的透明感知技术的认知机理和行为特征，揭示用户在语义选择过程中的认知机理和行为特征，揭示功能块的分布与用户行为模型和体验愉悦感之间的关系、透明性操作的愉悦体验度与认知操作负荷之间的关系及人-机之间透明协作之一般机理，为透明交互界面的研究提供系统性的认知基础；提出并构建迎合性计算模型、手势语义和操作手势的优化估计模型、虚拟界面及其透明感知模型等基本模型，为透明交互界面的研究提供一般性的数学模型；与普适计算的理论和方法进行交叉和融合，从不同的角度诠释信息空间和物理空间的表达方式及其融合的新途径。本项目将为数字智能电视等远程平台以及手机等移动平台提供全新的交互界面范式。

中文关键词： 人机交互；用户界面；人机交互技术；人机界面

英文摘要： For the pseudo nature problem in hand gesture driven 3D direct manipulation human-computer interaction interface, we conduct original research in three aspects, which are transparency of virtual interface, transparency of mappings among the three space and transparent catering respectively from three levels: theoretical models, technical methods and application prototype. We further reveal the cognitive mechanism and behavioral characteristics of transparent perception technology based on virtual interface, the cognitive mechanism and behavioral characteristics in the process of users' semantic selections, the relationship among the distribution of function blocks, users' behavior model and pleasure experience, the relationship between users' pleasure experience of transparent manipulations and cognitive loads, and the general mechanism of transparent collaboration between human and computer, which provide systematic cognitive foundations for the research of transparent interface. We propose and construct several general mathematical models for transparent interaction interface research, including catering computation models, optimized estimation models of gesture semantics and manipulative gestures, the virtual interface and its transparent cognitive models. Crossed and fused with the theory and method of pervasive computing, our methods provide a new presentation of information space and physical space from different points of view and a new way to fuse them. This project will provide new paradigms of human-computer interaction interface for remote platforms such as intelligent digital televisions and mobile platforms such as intelligent mobiles.

英文关键词： Human-computer Interaction;User Interface;Techniques of Human-computer Interaction;Human-computer Interface