Modelling the mapping from scene irradiance to image intensity is essential for many computer vision tasks. Such mapping is known as the camera response. Most digital cameras use a nonlinear function to map irradiance, as measured by the sensor to an image intensity used to record the photograph. Modelling of the response is necessary for the nonlinear calibration. In this paper, a new high-performance camera response model that uses a single latent variable and fully connected neural network is proposed. The model is produced using unsupervised learning with an autoencoder on real-world (example) camera responses. Neural architecture searching is then used to find the optimal neural network architecture. A latent distribution learning approach was introduced to constrain the latent distribution. The proposed model achieved state-of-the-art CRF representation accuracy in a number of benchmark tests, but is almost twice as fast as the best current models when performing the maximum likelihood estimation during camera response calibration due to the simple yet efficient model representation.
翻译:模拟从现场辐照到图像强度的映射对于许多计算机视觉任务至关重要。 这种映射被称为相机响应。 大多数数字相机使用非线性功能来绘制辐照, 由传感器测量为用于记录照片的图像强度。 非线性校准需要模拟响应。 在本文中, 提出了一个新的高性能相机响应模型, 使用单一潜伏变量和完全连通的神经网络。 该模型是使用在真实世界( example) 相机响应上与自动编码器一起进行的未经监督的学习来制作的。 神经结构搜索随后被用来寻找最佳的神经网络结构。 引入了一种潜在分布学习方法来限制潜在分布。 拟议的模型在一些基准测试中实现了最新水平的通用报告格式代表准确性, 但是由于简单而高效的模型代表性, 在相机反应校准过程中进行最大可能性估计时, 其速度几乎是当前最佳模型的两倍。