In this paper, we study two challenging but less-touched problems in image restoration, namely, i) how to quantify the relationship between different image degradations and ii) how to improve the performance of a specific restoration task using the quantified relationship. To tackle the first challenge, Degradation Relationship Index (DRI) is proposed to measure the degradation relationship, which is defined as the drop rate difference in the validation loss between two models, i.e., one is trained using the anchor task only and another is trained using the anchor and the auxiliary tasks. Through quantifying the relationship between different degradations using DRI, we empirically observe that i) the degradation combination proportion is crucial to the image restoration performance. In other words, the combinations with only appropriate degradation proportions could improve the performance of the anchor restoration; ii) a positive DRI always predicts the performance improvement of image restoration. Based on the observations, we propose an adaptive Degradation Proportion Determination strategy (DPD) which could improve the performance of the anchor restoration task by using another restoration task as auxiliary. Extensive experimental results verify the effective of our method by taking image dehazing as the anchor task and denoising, desnowing, and deraining as the auxiliary tasks. The code will be released after acceptance.
翻译:在本文中,我们研究了在图像恢复方面两个具有挑战性但不太容易处理的问题,即:一)如何量化不同图像退化之间的关系;二)如何利用量化关系来改进具体恢复任务的绩效;为了应对第一个挑战,建议退化关系指数(DRI)用来衡量退化关系,即两种模型(即,一个模型仅使用锚值任务进行培训,另一个模型使用锚值任务和辅助任务进行培训)之间的确认损失下降率差异。通过使用DRI对不同退化之间的关系进行量化,我们从经验上观察,i)退化组合比例对于图像恢复业绩至关重要。换句话说,只有适当降解比例的组合才能改善锚值恢复的绩效;二)积极的DRI指数总是预测图像恢复的绩效改善。根据观察,我们建议采用适应性退化比例确定战略(DPD),利用另一个锚值任务作为辅助性任务来改进固定恢复任务的绩效。广泛的实验结果通过将图像解析作为锚值任务来验证我们的方法的有效性。