面向空间物体的三维视线跟踪技术研究

项目名称： 面向空间物体的三维视线跟踪技术研究

项目编号： No.60872144

项目类型： 面上项目

立项/批准年度： 2009

项目学科： 武器工业

项目作者： 赵歆波

作者单位： 西北工业大学

项目金额： 30万元

中文摘要： 对使用者头部运动的限制以及因存在匹配环节导致无法保证视线对空间目标的跟踪精度，是基于光学的二维视线跟踪技术难以克服的问题。本项目实现了一种面向空间物体的三维视线跟踪技术，探索了该技术在人机交互、自动跟踪等领域的应用。利用一对立体相机和红外灯组成的光学系统，建立了一个实时眼图像采集系统，获得了高质量眼特征的三维信息；从眼睛第一普金野图像中，计算出眼睛角膜曲率中心准确的空间坐标。验证了瞳孔虚像中心和瞳孔中心均位于光轴上这一假设，从而实现了光轴和视轴的计算。基于平面镜实现了屏幕坐标系与摄像机坐标系的匹配。建立了一个双眼模型，进而开发出一个无需用户标定的三维视线跟踪系统；提出了一种基于注视点误差分布的统计学分析方法，给出了三维视线跟踪系统精度科学的分析方法。实现了扫描路径显示与分析，以及注视图的分析，在此基础上，探索了视线跟踪数据与视觉注意力机制的研究；研究了基于视线的智能信息输入技术，提出并实现了一种快速、便利的基于视线的汉字输入方法。利用基于视线的游戏控制，初步探索了视线跟踪在武器系统瞄准中的应用。研究成果表明，本项目提出的三维视线跟踪技术是可行的，对于视线跟踪及其应用研究，意义重大。

中文关键词： 视线跟踪；空间视线估计；三维

英文摘要： 2D Video-based eye tracking technologies exist two inherent problems which is difficult to overcome. One is the restriction on head-movement. The other is the difficulty to guarantee eye tracking accuracy of real scene-oriented due to existence of calibration procedure. In this project, a 3D eye tracking technology of real scene-oriented is developed. Meanwhile, applications of this technology is explored, such as human-computer interaction, automatic tracking, etc. Stereo cameras and infrared LEDs are used to compose optical system. Then a real-time eye image Acquisition system is built. Based on this system, 3D information of high quality eye features is gotten; 3D coordinates of cornea curvature center are computed from the first Purkinje image. The assumption that the virtual pupil center and the pupil center are both on the optical axe of eye has been verified. As the result, the optical axis and the visual axis are computed; the relation between computer screen coordinates and camera coordinates is established; a user-calibration-free 3D eye tracking system has been developed based on binocular model; a new quantitative analysis method to the accuracy of eye tracking system is proposed. This is based on Statistical method to analyze the distribution of gaze error; the scan path is displayed and analyzed. The saliency map is computed. Using gaze data, visual attention mechanism, intelligent information input technology are explored. A gaze-based Chinese character input method which is fast and convenient is deduced and implemented. Using gaze-based game controlling technology, preliminary exploration of weapon-aiming method is simulated. The results indicated that 3D eye tracking techniques of real scene-oriented is feasible. The research is significant for research on eye tracking and its application.

英文关键词： Eye Tracking; Estimation of visual axis; Three Dimension