Body movements carry important information about a person's emotions or mental state and are essential in daily communication. Enhancing the ability of machines to understand emotions expressed through body language can improve the communication of assistive robots with children and elderly users, provide psychiatric professionals with quantitative diagnostic and prognostic assistance, and aid law enforcement in identifying deception. This study develops a high-quality human motor element dataset based on the Laban Movement Analysis movement coding system and utilizes that to jointly learn about motor elements and emotions. Our long-term ambition is to integrate knowledge from computing, psychology, and performing arts to enable automated understanding and analysis of emotion and mental state through body language. This work serves as a launchpad for further research into recognizing emotions through analysis of human movement.
翻译:身体动作携带着重要的情感或心理状态信息,是日常交流中必须的要素。提高机器理解由身体语言表达的情感能力,有助于提升辅助机器人与儿童、老年人的交流,为精神科专业人员提供定量化诊断和预后诊断的帮助,以及帮助执法部门辨别欺骗行为。本研究基于拉班动作分析运动编码系统,开发了高质量的人体运动元素数据集,并利用其联合学习运动元素和情感的相关性。我们的长期目标是融合计算、心理学和表演艺术的知识,实现对身体语言中情感和心理状态的自动化理解和分析。本工作为进一步研究通过人体运动分析识别情感奠定了基础。