In this paper, we study two challenging but less-touched problems in image restoration, namely, i) how to quantify the relationship between different image degradations and ii) how to improve the performance on a specific degradation using the quantified relationship. To tackle the first challenge, Degradation Relationship Index (DRI) is proposed to measure the degradation relationship, which is defined as the mean drop rate difference in the validation loss between two models, i.e., one is trained using the anchor degradation only and another is trained based on both the anchor and the auxiliary degradations. Through quantifying the relationship between different degradations using DRI, we empirically observe that i) the degradation combination proportion is crucial to the image restoration performance. In other words, the combinations with only appropriate degradation proportions could improve the performance of the anchor restoration; ii) a positive DRI always predicts the performance improvement of image restoration. Based on the observations, we propose an adaptive Degradation Proportion Determination strategy (DPD) which could improve the performance on the anchor degradation with the assist of another auxiliary degradation. Extensive experimental results verify the effective of our method by taking haze as the anchor degradation and noise, rain streak, and snow as the auxiliary degradations. The code will be released after acceptance.
翻译:在本文中,我们研究了在图像恢复方面两个具有挑战性但不太容易理解的问题,即:一)如何量化不同图像退化之间的关系;二)如何利用量化关系来提高特定降解的性能;为了应对第一个挑战,建议退化关系指数(DRI)衡量退化关系,该指数的定义是两种模型之间验证损失中的平均下降率差,即一个模型仅使用锚降解进行训练,另一个模型则根据锚降解和辅助降解进行训练;通过利用DRI量化不同降解之间的关系,我们从经验上观察,i)降解组合比例对于图像恢复绩效至关重要;换言之,只有适当降解比例的结合才能改善锚恢复的性能;二)积极的DRI总能预测图像恢复的性能改善;根据观察结果,我们建议采用适应性退化比例确定战略(DPD),该战略可以提高锚降解的性能,同时协助进行另一个辅助降解。我们从广泛的实验结果中看到,我们的方法的有效性是,在锚降解、降压、降水、雪和再降为降解之后,将制雪作为辅助值。</s>