Motivated by their recent advances, deep learning techniques have been widely applied to low-light image enhancement (LIE) problem. Among which, Retinex theory based ones, mostly following a decomposition-adjustment pipeline, have taken an important place due to its physical interpretation and promising performance. However, current investigations on Retinex based deep learning are still not sufficient, ignoring many useful experiences from traditional methods. Besides, the adjustment step is either performed with simple image processing techniques, or by complicated networks, both of which are unsatisfactory in practice. To address these issues, we propose a new deep learning framework for the LIE problem. The proposed framework contains a decomposition network inspired by algorithm unrolling, and adjustment networks considering both global brightness and local brightness sensitivity. By virtue of algorithm unrolling, both implicit priors learned from data and explicit priors borrowed from traditional methods can be embedded in the network, facilitate to better decomposition. Meanwhile, the consideration of global and local brightness can guide designing simple yet effective network modules for adjustment. Besides, to avoid manually parameter tuning, we also propose a self-supervised fine-tuning strategy, which can always guarantee a promising performance. Experiments on a series of typical LIE datasets demonstrated the effectiveness of the proposed method, both quantitatively and visually, as compared with existing methods.
翻译:由于最近的进展,深层次的学习技术被广泛应用于低光图像增强问题,其中,基于Retinex理论的理论基础,主要是分解调整管道,由于其物理解释和良好的表现而占据了重要位置;然而,目前对基于Retinex深层学习的调查仍然不够,忽视了传统方法的许多有益经验;此外,调整步骤要么采用简单的图像处理技术,要么采用复杂的网络,两者在实践中都不尽如人意。为了解决这些问题,我们提议为LIE问题建立一个新的深层次学习框架。提议的框架包括一种分解网络,其灵感来自算法的解析,以及考虑到全球亮度和当地亮度的调整网络。由于算法的松动作用,从数据中隐含的先前和从传统方法中明确借用的先前经验都可以嵌入网络,有助于更好地解析。同时,考虑全球和地方的亮度可以指导设计简单而有效的网络模块。此外,为了避免手动参数的调整,我们还提议采用一种自我校准的精准调整战略,以及考虑到全球光度的调整网络的调整网络的网络的敏感性和调整网络的灵敏度。