Loss functions engineering and the assessment of forecasting performances are two crucial and intertwined aspects of supervised machine learning. This paper focuses on binary classification to introduce a class of loss functions that are defined on probabilistic confusion matrices and that allow an automatic and a priori maximization of the skill scores. The performances of these loss functions are validated during the training phase of two experimental forecasting problems, thus showing that the probability distribution function associated with the confusion matrices significantly impacts the outcome of the score maximization process.
翻译:损失职能工程和预测性能评估是监督机床学习的两个重要和相互交织的方面,本文件侧重于二元分类,以引入一组根据概率性混乱矩阵界定的损失职能,并允许自动和事先实现技能分数的最大化,这些损失职能的履行在两个实验性预测问题的培训阶段得到验证,从而表明与混乱矩阵相关的概率分布功能对得分最大化进程的结果产生重大影响。