基于深度学习的多尺度本质图像提取方法

项目名称： 基于深度学习的多尺度本质图像提取方法

项目编号： No.61502388

项目类型： 青年科学基金项目

立项/批准年度： 2016

项目学科： 计算机科学学科

项目作者： 蒋晓悦

作者单位： 西北工业大学

项目金额： 20万元

中文摘要： 图像成像过程受多种因素影响，使得图像中物体表象也随之变化。而提取物体本身固有形状、颜色、纹理等本质信息，可有效消除环境影响，实现对图像的准确理解。本课题旨在探索一种基于深度学习的多尺度本质图像分析方法，实现在多尺度上详细分析本质信息的目标。通过多尺度分析与重构框架，实现对图像的自由分解与无损重构。为实现对各尺度分量中本质信息的准确提取，分别基于图像亮度与形状、颜色、纹理关系构建全局特征；同时，基于多尺度深度学习网络构建局部特征。并利用相关性特征结合全局与局部特征，实现对各分量的准确分析。最后，对各分量中提取的本质信息通过重构框架实现无损重构。. 主要创新点在于摒弃了现有算法在单一尺度下通过求解能量优化问题估计本质图像的思路，而提出了多尺度下利用特征评价直接分析本质图像的方法。并针对各分量特点，构建了基于相关性的全局特征以及多尺度联合的局部特征，实现对本质图像的准确提取。

中文关键词： 图像理解；特征提取；局部特征

英文摘要： Multiple factors influence the appearance of an object in an image. However, extracting the intrinsic images from the observer image can eliminate the environmental impact effectively and make the image understanding more accurately. The intrinsic images represent the inherent shape, colour and texture information of the object. In this proposal, we aim to explore a method of multi-scale intrinsic image extraction based on deep learning. . Based on the framework of multi-scale analysis and reconstruction, an image can be decomposed into multi-scale and multi-orientation. In order to extract the intrinsic information from those components, we proposed to build a series of global and local features. The global features are based on the correlation between image intensity and shape, colour, texture, respectively. The local feature is constructed based on multi-scale deep learning methods, which can extract the multi-scale colour and texture information. Based on correlation features, the global and local features are combined to extract intrinsic information from multi-scale components. Consequently, the intrinsic images are reconstructed from those extracted information with the multi-scale analysis framework. . The main contribution of the proposal is the introduction of multi-scale analysis to intrinsic image extraction with the measurement of features, where most current intrinsic image extraction methods are based on solving optimization problems for the observed image directly. At the same time, we proposed to build global and local features based on the characteristics of each scale component.

英文关键词： Image Understanding;Feature Extraction;Local Feature