In machine learning, accurately predicting the probability that a specific input is correct is crucial for risk management. This process, known as uncertainty (or confidence) estimation, is particularly important in mission-critical applications such as autonomous driving. In this work, we put forward a novel geometric-based approach for improving uncertainty estimations in machine learning models. Our approach involves using the geometric distance of the current input from existing training inputs as a signal for estimating uncertainty, and then calibrating this signal using standard post-hoc techniques. We demonstrate that our method leads to more accurate uncertainty estimations than recently proposed approaches through extensive evaluation on a variety of datasets and models. Additionally, we optimize our approach so that it can be implemented on large datasets in near real-time applications, making it suitable for time-sensitive scenarios.
翻译:在机器学习中,准确预测具体投入正确的可能性对于风险管理至关重要。这一过程被称为不确定性(或信心)估算,在自主驱动等任务关键应用中特别重要。在这项工作中,我们提出了一种新的基于几何的方法,以改进机器学习模型中的不确定性估算。我们的方法是利用现有培训投入中现有投入的几何距离作为估计不确定性的信号,然后使用标准后热技术校准这一信号。我们证明,我们的方法通过广泛评价各种数据集和模型,比最近提出的方法更准确的不确定性估算。此外,我们优化了我们的方法,以便能够在近实时应用中的大型数据集上实施,使之适合时间敏感情景。