We apply machine learning methods to predict chemical hazards focusing on fish acute toxicity across taxa. We analyze the relevance of taxonomy and experimental setup, and show that taking them into account can lead to considerable improvements in the classification performance. We quantify the gain obtained by introducing the taxonomic and experimental information, compared to classifying based on chemical information alone. We use our approach with standard machine learning models (K-nearest neighbors, random forests and deep neural networks), as well as the recently proposed Read-Across Structure Activity Relationship (RASAR) models, which were very successful in predicting chemical hazards to mammals based on chemical similarity. We are able to obtain accuracies of over 0.93 on datasets where, due to noise in the data, the maximum achievable accuracy is expected to be below 0.95, which results in an effective accuracy of 0.98. The best performances are obtained by random forests and RASAR models. We analyze metrics to compare our results with animal test reproducibility, and despite most of our models 'outperform animal test reproducibility' as measured through recently proposed metrics, we show that the comparison between machine learning performance and animal test reproducibility should be addressed with particular care. While we focus on fish mortality, our approach, provided that the right data is available, is valid for any combination of chemicals, effects and taxa.
翻译:我们采用机器学习方法,预测化学危害,重点针对不同分类群的鱼类急性毒性。我们分析了分类学和实验设置的相关性,并表明,考虑到这些分类学和实验设置的相关性,可以大大改进分类性能。我们量化通过采用分类和实验信息而获得的收益,而仅根据化学信息进行分类。我们采用标准机学习模型(K-近邻、随机森林和深神经网络)以及最近提出的阅读-跨结构活动关系模型(RASAR),这些模型在预测哺乳动物的化学危害方面非常成功。我们能够在数据集上获得0.93的精度,由于数据中的噪音,预期最高可实现的精确度将低于0.95,结果有效精确度为0.98。随机森林和RASAR模型提供了最佳的性能。我们分析了测量我们的结果与动物测试的可复制性比较度,尽管我们的大多数模型“根据最近提出的指标测量,对哺乳动物的化学危害进行了不精确性测试”。我们能够取得0.93的精度,因为由于数据的噪音,因此,我们的数据与鱼类的精确性、对死亡率的测量效果进行了比较,我们提供了有效的研究。