Text Classification is an integral part of many Natural Language Processing tasks such as sarcasm detection, sentiment analysis and many more such applications. Many e-commerce websites, social-media/entertainment platforms use such models to enhance user-experience to generate traffic and thus, revenue on their platforms. In this paper, we are presenting our solution to Multilingual Abusive Comment Identification Problem on Moj, an Indian video-sharing social networking service, powered by ShareChat. The problem dealt with detecting abusive comments, in 13 regional Indic languages such as Hindi, Telugu, Kannada etc., on the videos on Moj platform. Our solution utilizes the novel muBoost, an ensemble of CatBoost classifier models and Multilingual Representations for Indian Languages (MURIL) model, to produce SOTA performance on Indic text classification tasks. We were able to achieve a mean F1-score of 89.286 on the test data, an improvement over baseline MURIL model with a F1-score of 87.48.
翻译:许多电子商务网站、社交媒体/娱乐平台使用这些模型来提高用户经验,以产生交通量,从而增加其平台的收入。在本文中,我们正在介绍我们对印度视频共享社交网络服务ShareChat所推动的Moj的多语种批量意见识别问题的解决办法。问题涉及在Moj平台的视频中用印地语、泰鲁古语、坎纳达语等13种地区印度语查找滥用性评论。我们的解决方案利用了新型的 MuBoost,即CatBoost分类模型和印度语言多语言代表模式(MURIL),以产生SOTA在Indic文本分类任务方面的表现。我们得以在测试数据上实现89 286个平均F1-核心,比F1-核心87.48的基线MURIL模型有所改进。