The Korean wave, which denotes the global popularity of South Korea's cultural economy, contributes to the increasing demand for the Korean language. However, as there does not exist any application for foreigners to learn Korean, this paper suggested a design of a novel Korean learning application. Speech recognition, speech-to-text, and speech-to-waveform are the three key systems in the proposed system. The Google API and the librosa library will transform the user's voice into a sentence and MFCC. The software will then display the user's phrase and answer, with mispronounced elements highlighted in red, allowing users to more easily recognize the incorrect parts of their pronunciation. Furthermore, the Siamese network might utilize those translated spectrograms to provide a similarity score, which could subsequently be used to offer feedback to the user. Despite the fact that we were unable to collect sufficient foreigner data for this research, it is notable that we presented a novel Korean pronunciation correction method for foreigners.
翻译:韩国的浪潮代表了韩国文化经济在全球的受欢迎程度,它促使韩国对韩国语言的需求不断增加。然而,由于没有外国人学习韩国语的任何申请,本文建议设计一个韩国新学习应用程序。语音识别、语音对文本和语音对波格式是拟议系统中的三个关键系统。Google API和librosa图书馆将把用户的声音转换成句子和MFCC。 软件随后将展示用户的语句和回答,用红色显示错误的语句和回答,让用户更容易识别其发音的不正确部分。 此外,暹罗网络可能利用这些翻译的光谱来提供相似的分数,随后可以用来向用户提供反馈。尽管我们无法为这项研究收集到足够的外国人数据,但值得注意的是,我们为外国人提出了一个韩国语读音校正方法。