Hate speech is a major issue in social networks due to the high volume of data generated daily. Recent works demonstrate the usefulness of machine learning (ML) in dealing with the nuances required to distinguish between hateful posts from just sarcasm or offensive language. Many ML solutions for hate speech detection have been proposed by either changing how features are extracted from the text or the classification algorithm employed. However, most works consider only one type of feature extraction and classification algorithm. This work argues that a combination of multiple feature extraction techniques and different classification models is needed. We propose a framework to analyze the relationship between multiple feature extraction and classification techniques to understand how they complement each other. The framework is used to select a subset of complementary techniques to compose a robust multiple classifiers system (MCS) for hate speech detection. The experimental study considering four hate speech classification datasets demonstrates that the proposed framework is a promising methodology for analyzing and designing high-performing MCS for this task. MCS system obtained using the proposed framework significantly outperforms the combination of all models and the homogeneous and heterogeneous selection heuristics, demonstrating the importance of having a proper selection scheme. Source code, figures, and dataset splits can be found in the GitHub repository: https://github.com/Menelau/Hate-Speech-MCS.
翻译:由于每天生成的数据量很大,仇恨言论是社交网络的一个主要问题。最近的工作表明机器学习(ML)对于处理区分仇恨性文章所需的细微差别所需的细微差别很有用。许多关于仇恨言论检测的 ML 解决方案是通过改变从文本中提取特征的方法或采用的分类算法而提出的。然而,大多数工作只考虑一种类型的特征提取和分类算法。这项工作认为,需要将多种特征提取技术和不同的分类模型结合起来。我们提出了一个框架,分析多重特征提取和分类技术之间的关系,以了解它们如何相互补充。这个框架用来选择一组补充技术,以构建一个强有力的多分类系统,用于仇恨言论检测。关于四种仇恨言论分类数据集的实验研究表明,拟议的框架是分析和设计高性能的MSC算法。利用拟议的框架获得的MCS系统大大超越了所有模型和同质和分级选择高科技的组合,显示了拥有正确选择方案的重要性。源代码、数字和数据分割了GiSub-M.M. 在Gius-Squ-M. 中可以找到一个很有选择方案的源码、数字和数据分割存储器。