Style may refer to different concepts (e.g. painting style, hairstyle, texture, color, filter, etc.) depending on how the feature space is formed. In this work, we propose a novel idea of interpreting the lighting in the single- and multi-illuminant scenes as the concept of style. To verify this idea, we introduce an enhanced auto white-balance (AWB) method that models the lighting in single- and mixed-illuminant scenes as the style factor. Our AWB method does not require any illumination estimation step, yet contains a network learning to generate the weighting maps of the images with different WB settings. Proposed network utilizes the style information, extracted from the scene by a multi-head style extraction module. AWB correction is completed after blending these weighting maps and the scene. Experiments on single- and mixed-illuminant datasets demonstrate that our proposed method achieves promising correction results when compared to the recent works. This shows that the lighting in the scenes with multiple illuminations can be modeled by the concept of style. Source code and trained models are available on https://github.com/birdortyedi/lighting-as-style-awb-correction.
翻译:样式可以指不同的概念(例如,油漆样式、发型、纹理、颜色、过滤等),取决于特征空间是如何形成的。在这项工作中,我们提出了一个新颖的想法,将单一和多光光景中的照明作为样式概念来解释。为了验证这一想法,我们采用了一种强化自动白平衡(AWB)方法,在单一和混合光照场中模拟照明作为样式要素。我们的AWB方法不需要任何照明估计步骤,但包含一个网络学习以生成不同WB设置的图像的加权地图。拟议网络使用由多头风格提取模块从场景中提取的样式信息。在混合这些加权地图和场景之后,AWB的校正已经完成。在单一和混合光照光场上进行的实验表明,与最近的工作相比,我们拟议的方法取得了有希望的校正结果。这表明,在多光点的场景中的照明可以通过样式概念来建模。源代码和经过培训的模型可以在 https://githuba/bortyraimation上提供。