Deep learning (DL) models have received particular attention in medical imaging due to their promising pattern recognition capabilities. However, Deep Neural Networks (DNNs) require a huge amount of data, and because of the lack of sufficient data in this field, transfer learning can be a great solution. DNNs used for disease diagnosis meticulously concentrate on improving the accuracy of predictions without providing a figure about their confidence of predictions. Knowing how much a DNN model is confident in a computer-aided diagnosis model is necessary for gaining clinicians' confidence and trust in DL-based solutions. To address this issue, this work presents three different methods for quantifying uncertainties for skin cancer detection from images. It also comprehensively evaluates and compares performance of these DNNs using novel uncertainty-related metrics. The obtained results reveal that the predictive uncertainty estimation methods are capable of flagging risky and erroneous predictions with a high uncertainty estimate. We also demonstrate that ensemble approaches are more reliable in capturing uncertainties through inference.
翻译:深入学习(DL)模型由于其有希望的模式识别能力,在医学成像中受到特别关注;然而,深神经网络(DNN)需要大量的数据,而且由于缺乏这方面的足够数据,转移学习可能是一个伟大的解决办法。用于疾病诊断的DNNN仔细地专注于提高预测的准确性,而没有提供预测可信度的数字。了解DNN模型对计算机辅助诊断模型的多少信心对于获得临床医生对DL解决方案的信心和信任是必要的。为解决这一问题,这项工作提出了用图像来量化皮肤癌检测的不确定性的三种不同方法。还利用与不确定性有关的新指标对这些DNNS的性能进行了全面评估和比较。获得的结果表明,预测性不确定性估计方法能够将危险和错误的预测与高度的不确定性估计挂上标签。我们还表明,通过推断来捕捉不确定性的方法更加可靠。