We present edBB-Demo, a demonstrator of an AI-powered research platform for student monitoring in remote education. The edBB platform aims to study the challenges associated to user recognition and behavior understanding in digital platforms. This platform has been developed for data collection, acquiring signals from a variety of sensors including keyboard, mouse, webcam, microphone, smartwatch, and an Electroencephalography band. The information captured from the sensors during the student sessions is modelled in a multimodal learning framework. The demonstrator includes: i) Biometric user authentication in an unsupervised environment; ii) Human action recognition based on remote video analysis; iii) Heart rate estimation from webcam video; and iv) Attention level estimation from facial expression analysis.
翻译:我们展示了EdBB-Demo,这是远程教育中学生监测的AI动力研究平台的演示人。EdBB-Demo平台旨在研究数字平台中与用户认识和行为理解有关的挑战。该平台是为收集数据而开发的,从键盘、鼠标、网络摄像头、麦克风、智能观察和电脑摄影乐队等各种传感器获取信号。在学生学习过程中从传感器中获取的信息以多式学习框架为模范。演示人包括:(一) 在不受监督的环境中生物测定用户认证;(二) 基于远程视频分析的人类行动识别;(三) 从网络摄像头视频的心率估计;以及(四) 面部表达分析的注意程度估计。