基于眼动追踪的智能教学Agent情感交互与认知支持模型研究

项目名称： 基于眼动追踪的智能教学Agent情感交互与认知支持模型研究

项目编号： No.61305144

项目类型： 青年科学基金项目

立项/批准年度： 2014

项目学科： 自动化技术、计算机技术

项目作者： 詹泽慧

作者单位： 华南师范大学

项目金额： 26万元

中文摘要： 师生和生生间的时空分离状态容易导致远程学习过程中情感信息的缺失，使学习者产生孤独无助和迷茫懒散的情绪。为了弥补这一缺陷，教学Agent应运而生，以鲜活的拟人形象出现在计算机辅助教学过程中，有利于增加趣味性和减轻认知负荷。然而现有的Agent普遍存在两方面问题：一是只具备单向的情感传输功能而缺乏情感交互性；二是认知推断功能薄弱，对学习效果的促进作用不稳定，一些学习者甚至认为Agent干扰了他们正常的浏览和阅读。基于此，本项目尝试利用眼动追踪技术为教学Agent添上"眼睛"，以实时监测学习者的眼动状态和视线路径，与摄像头同步监测到的表情状态相互验证和修正，编码识别出学习者的情感状态和认知状态，建立情感与认知耦合模型，推断并呈现Agent最优的情感反馈（表情、语言、动作）和认知反馈（知识点相关提示、学习方法建议）。建立Agent原型并开展教学实验分析其对远程学习者认知加工过程的作用机制。

中文关键词： 智能教学代理；眼动追踪；阅读能力；虚拟助理；智能导师系统

英文摘要： The space and time gap between instructors and student would easily cause lack of emotional information in distance education, which might lead to students' helpless and lost mood during learning process. In order to deal with this problem, Pedagogical Agent arises at the historic moment, which present in the computer assisted learning process with fresh personification image that is beneficial to increase learners' interest and reduce cognitive loads. However, there are two kinds of defects in most of the exist pedagogical agents: one is they only have sigal-direction emotional transmission function and lack of interaction; the second fault is their cognitive function is weak and the effect on enhancing learning is not stable. Some learners even thank that the agent interfere with their normal browsing and reading. Based on this, this project attempts to use eye movement tracking technique to add "eyes" on pedagogical agents, in order to monitor distance learners' eye movement states and their sight path. The eye movement tracking data would interact with learner's face expression data which was achieved by camera, so as to guarantee the results of emotional identification are correct. The sight path tracking data would go with the learning contents and be coded to indentify learner's cognitive status. The emot

英文关键词： intelligent pedagogical agent；eye-tracking；reading ability；virtual assistant；intelligent tutoring system