The content based image retrieval aims to find the similar images from a large scale dataset against a query image. Generally, the similarity between the representative features of the query image and dataset images is used to rank the images for retrieval. In early days, various hand designed feature descriptors have been investigated based on the visual cues such as color, texture, shape, etc. that represent the images. However, the deep learning has emerged as a dominating alternative of hand-designed feature engineering from a decade. It learns the features automatically from the data. This paper presents a comprehensive survey of deep learning based developments in the past decade for content based image retrieval. The categorization of existing state-of-the-art methods from different perspectives is also performed for greater understanding of the progress. The taxonomy used in this survey covers different supervision, different networks, different descriptor type and different retrieval type. A performance analysis is also performed using the state-of-the-art methods. The insights are also presented for the benefit of the researchers to observe the progress and to make the best choices. The survey presented in this paper will help in further research progress in image retrieval using deep learning.
翻译:基于内容的图像检索旨在根据查询图像查找来自大型数据集的类似图像。一般而言,查询图像和数据集图像的代表性特征之间的相似性被用来对图像进行排序。在早期,根据显示图像的视觉提示(如颜色、纹理、形状等),对各种手工设计的特征描述符进行了调查。然而,深层次的学习已成为十年来手工设计的特征工程的一种主导替代方法。它自动从数据中学习特征。本文展示了过去十年中基于内容图像检索的深层次学习发展动态的全面调查。从不同角度对现有的最新方法进行分类,以便更好地了解进展情况。本调查中使用的分类包括不同的监督、不同的网络、不同的描述符类型和不同的检索类型。还利用最新的方法进行了绩效分析。还介绍了这些深入的见解,以利研究人员观察进展情况和作出最佳选择。本文中介绍的调查将有助于利用深层学习对图像检索进行进一步的研究。