General deep learning-based methods for infrared and visible image fusion rely on the unsupervised mechanism for vital information retention by utilizing elaborately designed loss functions. However, the unsupervised mechanism depends on a well designed loss function, which cannot guarantee that all vital information of source images is sufficiently extracted. In this work, we propose a novel interactive feature embedding in self-supervised learning framework for infrared and visible image fusion, attempting to overcome the issue of vital information degradation. With the help of self-supervised learning framework, hierarchical representations of source images can be efficiently extracted. In particular, interactive feature embedding models are tactfully designed to build a bridge between the self-supervised learning and infrared and visible image fusion learning, achieving vital information retention. Qualitative and quantitative evaluations exhibit that the proposed method performs favorably against state-of-the-art methods.
翻译:红外线和可见图像聚合的一般深层学习方法依靠未经监督的重要信息保留机制,利用精心设计的损失功能;然而,未经监督的机制依赖于设计完善的损失功能,无法保证源图像的所有重要信息都得到充分提取;在这项工作中,我们提议在红外和可见图像聚合的自监督学习框架中嵌入一个新的互动功能,试图克服重要信息退化的问题;在自我监督学习框架的帮助下,源图像的等级表征可以有效提取;特别是,交互式地物嵌入模型的设计,目的是在自监督学习与红外和可见图像聚合学习之间架起桥梁,实现重要信息保留。定性和定量评价显示,拟议方法与最新技术方法相适应。