We applied machine learning methods to predict chemical hazards focusing on fish acute toxicity across taxa. We analyzed the relevance of taxonomy and experimental setup, showing that taking them into account can lead to considerable improvements in the classification performance. We quantified the gain obtained throught the introduction of taxonomic and experimental information, compared to classification based on chemical information alone. We used our approach with standard machine learning models (K-nearest neighbors, random forests and deep neural networks), as well as the recently proposed Read-Across Structure Activity Relationship (RASAR) models, which were very successful in predicting chemical hazards to mammals based on chemical similarity. We were able to obtain accuracies of over 93% on datasets where, due to noise in the data, the maximum achievable accuracy was expected to be below 96%. The best performances were obtained by random forests and RASAR models. We analyzed metrics to compare our results with animal test reproducibility, and despite most of our models "outperform animal test reproducibility" as measured through recently proposed metrics, we showed that the comparison between machine learning performance and animal test reproducibility should be addressed with particular care. While we focused on fish mortality, our approach, provided that the right data is available, is valid for any combination of chemicals, effects and taxa.
翻译:我们采用了机器学习方法来预测化学危害,重点是不同分类群的鱼类急性毒性。我们分析了分类学和实验设置的相关性,表明考虑到这些分类学和实验设置可以大大改善分类性能。我们量化了通过采用分类和实验信息而获得的收益,而仅根据化学信息进行分类。我们采用了标准机学习模型(K-近邻、随机森林和深神经网络)以及最近提出的“阅读-跨结构活动关系”模型,这些模型在预测哺乳动物的化学危害方面非常成功。我们能够在数据集上获得超过93%的精度,由于数据中的噪音,最高可实现的精确度预计将低于96%。最佳的性能来自随机森林和RASAR模型。我们分析了各种衡量标准,以比较我们的结果和动物测试的可复制性,尽管我们的大多数模型“不完善的动物测试活动关系(RASAR)”模型是根据最近提出的指标测量的,我们在预测哺乳动物的化学危害方面非常成功。我们展示了对机器学习性能和动物试验效果的精确性能的比较,我们所提供的数据应侧重于鱼类的税制死亡率。