基于脑电信号的藏语拉萨话韵律认知理论研究

项目名称： 基于脑电信号的藏语拉萨话韵律认知理论研究

项目编号： No.61462075

项目类型： 地区科学基金项目

立项/批准年度： 2015

项目学科： 计算机科学学科

项目作者： 于洪志

作者单位： 西北民族大学

项目金额： 45万元

中文摘要： 本项目将脑电技术与语音信息处理相结合，分析藏语拉萨话言语韵律、情感韵律认知方式，两种韵律特征对语义理解的影响。研究包括：声调、语调、重音的认知机制研究；韵律情绪的识别；韵律情绪和语义情绪的自动加工、韵律认知模型、韵律认知理论四部分。创新点:1）使用认知神经分析的方法，进行藏语拉萨话语音韵律认知研究。2）结合脑电信号与脑溯源技术，来研究大脑韵律信息处理的时空特征。3）将情感韵律和言语韵律对比研究。拟解决的关键科学问题：1）分析合成语音韵律与自然语流韵律在识别过程中的差异性，探究韵律感知和声学识别之间的对应关系。2）借助脑电信号，研究藏语拉萨话韵律认知的时间进程，借助偶极子定位探讨韵律加工的空间特性，分析言语与非言语过程中基频、能量等声学参数的改变对大脑感知的影响异同。3）对比言语韵律和情感韵律认知加工的异同。最终得到藏语拉萨话韵律感知神经模型,归纳出藏语拉萨话韵律识别的认知理论。

中文关键词： 韵律认知；藏语拉萨话；脑电信号；声学处理；信息处理

英文摘要： Combining EEG technology and speech engineering, this project intends to study the cognitive styles of speech prosody and affective prosody of Lhasa Tibetan and the affection that both prosodies' characters on semantic comprehension. The main study are three parts: first, it is about the cognitive mechanism for the tone, intonation and stress; second, it is about the recognition for the affective prosody; third, it is about the automatic processing for the prosodic emotion and semantic emotion. The innovation points of this project lay in: 1) using cognitive neuroscience to study the prosody of Tibetan speech; 2) combining EEG technology and traceability technology to study the cognitive features in time and space processing; 3) taking a comparative study between speech prosody and affective prosody. The problems we try to solve: 1) exploring the corresponding relation between prosodic perception and acoustic recognition by the analysis, and finding the differences between synthetic speech prosody and natural speech prosody in cognition;2) doing research on the time processing features with the EEG signal, doing research on the space processing features with the dipole localization, with the both results to find the influence that the changes of fundamental frequency, power and other parameters on the perception in synthetic speech and natural speech;3) exploring the models of prosody recognition and cognition for Lhasa Tibetan, and the recognition theories of prosody recognition for Lhasa Tibetan, which base on the a comparison between the speech prosody and affective prosody's process.

英文关键词： Prosodic Cognition;Lhasa Tibetan;EEG Signal;acoustic data processor;information processing