The Berber, or Amazigh language family is a low-resource North African vernacular language spoken by the indigenous Berber ethnic group. It has its own unique alphabet called Tifinagh used across Berber communities in Morocco, Algeria, and others. The Afroasiatic language Berber is spoken by 14 million people, yet lacks adequate representation in education, research, web applications etc. For instance, there is no option of translation to or from Amazigh / Berber on Google Translate, which hosts over 100 languages today. Consequently, we do not find specialized educational apps, L2 (2nd language learner) acquisition, automated language translation, and remote-access facilities enabled in Berber. Motivated by this background, we propose a supervised approach called DaToBS for Detection and Transcription of Berber Signs. The DaToBS approach entails the automatic recognition and transcription of Tifinagh characters from signs in photographs of natural environments. This is achieved by self-creating a corpus of 1862 pre-processed character images; curating the corpus with human-guided annotation; and feeding it into an OCR model via the deployment of CNN for deep learning based on computer vision models. We deploy computer vision modeling (rather than language models) because there are pictorial symbols in this alphabet, this deployment being a novel aspect of our work. The DaToBS experimentation and analyses yield over 92 percent accuracy in our research. To the best of our knowledge, ours is among the first few works in the automated transcription of Berber signs from roadside images with deep learning, yielding high accuracy. This can pave the way for developing pedagogical applications in the Berber language, thereby addressing an important goal of outreach to underrepresented communities via AI in education.
翻译:摘要:柏柏尔语或阿马齐格语系是一种低资源度的北非土语,由本土柏柏尔族使用,拥有自己独特的字母表Tifinagh,广泛分布于摩洛哥、阿尔及利亚等柏柏尔社区中。非洲亚细亚语系的柏柏尔语由1400万人使用,但是在教育、研究、网络应用等方面没有得到充分的代表性。例如,在Google翻译等翻译软件中还没有针对阿马齐格/柏柏尔语的翻译选项,而Google翻译现已提供100种语言以上的翻译。因此,在柏柏尔语中并没有专门的教育应用、第二语言习得、自动化语言翻译以及远程访问等功能。基于这样的背景,我们提出了一种监督学习方法,称为DaToBS,用于检测和转录柏柏尔符号。DaToBS方法利用计算机视觉模型基于深度学习的卷积神经网络,实现了从自然环境照片中识别和转录Tifinagh字母的自动化过程。这是通过自行创建一个包含1862个经过预处理的字符图像的语料库,通过人类引导注释对其进行筛选和整理,并将其馈入OCR模型来实现的。我们使用了计算机视觉建模而不是语言建模,因为Tifinagh字母表中有象形符号,这在我们的工作中是一个新颖的方面。DaToBS实验和分析研究显示出92%以上的准确度。我们的研究是从道路图像中自动转录柏柏尔符号的首批研究之一,并具有高准确性。这可以为开发柏柏尔语教育应用奠定基础,从而通过教育领域的AI推动向未代表社群进行宣传的重要目标。