基于目标语义的网络图像检索技术研究

项目名称： 基于目标语义的网络图像检索技术研究

项目编号： No.61472422

项目类型： 面上项目

立项/批准年度： 2015

项目学科： 计算机科学学科

项目作者： 刘静

作者单位： 中国科学院自动化研究所

项目金额： 83万元

中文摘要： 基于目标语义的网络图像检索是在新一代互联网背景下有效满足用户精准搜索需求的发展必然，同时也面临着数据规模巨大、噪音信息充斥、索引与搜索粒度精细等现实挑战。在此背景下，本项目将围绕基于目标语义的网络搜索相关技术展开研究，力图通过计算手段实现针对图像目标对象的细粒度语义理解，并基于此构建适于反映图像所包含目标对象的特征索引与搜索排序算法，准确捕捉用户的查询意图，以便提供更加友好、快捷、准确的网络图像资源检索服务。具体拟将从以下四方面展开研究：（1）基于多模态特征之间相容互补特性的图像特征融合与表示；（2）将图像整体标注、区域标注和区域分割相统一的基于弱监督学习的目标语义解析计算框架；（3）联合考虑网络媒体复杂关联与目标语义指导的图像特征索引构建；（4）基于相关反馈的用户查询意图推断与搜索排序算法。

中文关键词： 图像检索；目标语义；语义解析

英文摘要： With the advance of digital cameras and high quality mobile devices as well as the internet technologies, there are increasingly large amounts of images available on the web, which necessitates effective and efficient image retrieval techniques. Among them, object semantics based image retrieval (OSIR) becomes a newly-developing and potential direction to meet users' high requirement for precise image searching, which is our focus in this proposal. Different from traditional content based image retrieval, the main target of OSIR is to provide object-centric image retrieval framework, in which we should understand image semantics and user query intents from the object level. That is, we should find out the objects included in each image, and provide relevant images on object semantics to users. To achieve this target, we propose to carry out the framework from the following four aspects. First, we will study the characteristics of consistency and complementary among multi-modal image features, based on which we propose effective solutions for feature fusion and representation. Second, the problem of image semantic parsing will be explored with a unified framework, in which image-level annotation, region-level annotation (i.e., object semantic understanding), and image segmentation are jointly explored. Third, in order to achieve an efficient and effective image retrieval system, we will attempt to construct an object-centric image indexing structure with consideration of complex correlations among images on social websites. Finally, how to learn users' query intent and further to rank images based on object semantics will be deeply studied.

英文关键词： Image Retrieval;Object Semantics;Semantic Parsing