Monitoring students' engagement and understanding their learning pace in a virtual classroom becomes challenging in the absence of direct eye contact between the students and the instructor. Continuous monitoring of eye gaze and gaze gestures may produce inaccurate outcomes when the students are allowed to do productive multitasking, such as taking notes or browsing relevant content. This paper proposes Stungage - a software wrapper over existing online meeting platforms to monitor students' engagement in real-time by utilizing the facial video feeds from the students and the instructor coupled with a local on-device analysis of the presentation content. The crux of Stungage is to identify a few opportunistic moments when the students should visually focus on the presentation content if they can follow the lecture. We investigate these instances and analyze the students' visual, contextual, and cognitive presence to assess their engagement during the virtual classroom while not directly sharing the video captures of the participants and their screens over the web. Our system achieves an overall F2-score of 0.88 for detecting student engagement. Besides, we obtain 92 responses from the usability study with an average SU score of 74.18.
翻译:在虚拟教室里监测学生的参与和理解学生的学习速度,在学生和教员之间没有直接的眼接触的情况下,监测学生的参与和理解他们的学习速度变得很困难。当学生被允许从事生产性的多任务工作,例如记录或浏览相关内容时,持续监测眼视和眼视手势可能会产生不准确的结果。本文提议在现有的在线会议平台上添加软封条,用学生和教员的面部视频资料来实时监测学生的参与情况,同时对演示内容进行局部的在线设备分析。Stungage的关键是确定一些机会性的时刻,学生如果能够听讲的话,应该视觉地关注演示内容。我们调查这些事件,分析学生的视觉、背景和认知存在,以评估他们在虚拟教室中的参与情况,同时不在网上直接分享学员及其屏幕的视频捕获情况。我们的系统在检测学生的参与情况方面获得了总体F2-核心为0.88。此外,我们从可用性研究中获得92个答复,平均SU分为74.18。