Improving the robustness of neural nets in regression tasks is key to their application in multiple domains. Deep learning-based approaches aim to achieve this goal either by improving their prediction of specific values (i.e., point prediction), or by producing prediction intervals (PIs) that quantify uncertainty. We present PIVEN, a deep neural network for producing both a PI and a value prediction. Our loss function expresses the value prediction as a function of the upper and lower bounds, thus ensuring that it falls within the interval without increasing model complexity. Moreover, our approach makes no assumptions regarding data distribution within the PI, making its value prediction more effective for various real-world problems. Experiments and ablation tests on known benchmarks show that our approach produces tighter uncertainty bounds than the current state-of-the-art approaches for producing PIs, while maintaining comparable performance to the state-of-the-art approach for value-prediction. Additionally, we go beyond previous work and include large image datasets in our evaluation, where PIVEN is combined with modern neural nets.
翻译:提高神经网在回归任务中的坚固性是其在多个领域应用的关键。深层次的学习方法旨在实现这一目标,要么改进对具体值的预测(即点预测),要么制定量化不确定性的预测间隔(PIS)。我们提出了PIVEN,这是一个用于生产 PI 和价值预测的深层神经网络。我们的损失函数表示价值预测是上下界的函数,从而确保它处于间隔之内,而不会增加模型复杂性。此外,我们的方法没有就PI内部的数据分布作出假设,使其价值预测对各种现实世界问题更有效。对已知基准的实验和调整测试表明,我们的方法比目前生产PIS的先进方法产生更严格的不确定性界限,同时保持与最新的价值定位方法的可比性性能。此外,我们超越了以往的工作,在我们的评估中包括大型图像数据集,因为PIVEN与现代的神经网相结合。