In this paper, we present a Neural Preset technique to address the limitations of existing color style transfer methods, including visual artifacts, vast memory requirement, and slow style switching speed. Our method is based on two core designs. First, we propose Deterministic Neural Color Mapping (DNCM) to consistently operate on each pixel via an image-adaptive color mapping matrix, avoiding artifacts and supporting high-resolution inputs with a small memory footprint. Second, we develop a two-stage pipeline by dividing the task into color normalization and stylization, which allows efficient style switching by extracting color styles as presets and reusing them on normalized input images. Due to the unavailability of pairwise datasets, we describe how to train Neural Preset via a self-supervised strategy. Various advantages of Neural Preset over existing methods are demonstrated through comprehensive evaluations. Notably, Neural Preset enables stable 4K color style transfer in real-time without artifacts. Besides, we show that our trained model can naturally support multiple applications without fine-tuning, including low-light image enhancement, underwater image correction, image dehazing, and image harmonization. Project page with demos: https://zhkkke.github.io/NeuralPreset .
翻译:在本文中,我们提出了一种神经预设技术,以解决现有色彩风格迁移方法的局限性,包括视觉伪影,大内存需求,和较慢的风格切换速度。我们的方法基于两个核心设计。首先,我们提出确定性神经色彩映射(DNCM),通过图像自适应的色彩映射矩阵每个像素进行一致的处理,避免伪影,并支持具有小内存占用量的高分辨率输入。其次,我们通过将任务分成颜色规范化和样式化两个阶段,开发了一种二阶段管道,允许通过提取颜色样式作为预设并在规范化的输入图像上重用它们来实现高效的风格切换。由于不存在成对数据集,我们描述了如何通过自监督学习策略训练神经预设。通过全面的评估来展示了神经预设相对于现有方法的各种优势。值得注意的是,神经预设可以在实时环境下稳定地进行4K色彩风格迁移,而且不会出现伪影。此外,我们展示了我们训练的模型可以在不进行微调的情况下自然地支持多种应用,包括低光图像增强,水下图像修正,图像去雾以及图像协调。项目页面及演示:https://zhkkke.github.io/NeuralPreset。