Image pre-classification based on saliency map for image retrieval

Zhen Liang, Hong Fu, Zheru Chi, Dagan Feng

Research output: Chapter in book / Conference proceedingConference article published in proceeding or bookAcademic researchpeer-review

5 Citations (Scopus)

Abstract

In content-based image retrieval, it is helpful to add a pre-classification module to classify a query image into attentive class or non-attentive class. Based on the pre-classification result, a suitable retrieval strategy is adopted for the query image presented. In this paper, we proposed a Multi-Layer Perceptron (MLP) classifier with the features extracted from saliency map to classify both the query image and database images into attentive images and non-attentive classed. A dataset of 1,000 images was selected from the 7,346 Hemera color image database for our experiments. Various features extracted from the saliency map are investigated, including the number and the average size of saliency regions, the variance of the sizes of saliency regions, as well as the sizes of the three most conspicuous saliency regions. The number and average size of saliency regions in the saliency map are shown to be the most discriminative features with which a classification rate of better than 98% can be achieved. To facilitate multi-strategy image retrieval, we define an attentive index between 0 and 1 based on the two most discriminative features to indicate how attentive an image is. Finally, two image retrieval strategies based on the attentive index are proposed, and the corresponding image retrieval performances are evaluated on the 7,346 Hemera color image database with a comparison with the other conventional image retrieval methods.
Original languageEnglish
Title of host publicationICICS 2009 - Conference Proceedings of the 7th International Conference on Information, Communications and Signal Processing
DOIs
Publication statusPublished - 1 Dec 2009
Event7th International Conference on Information, Communications and Signal Processing, ICICS 2009 - Macau Fisherman's Wharf, Macao
Duration: 8 Dec 200910 Dec 2009

Conference

Conference7th International Conference on Information, Communications and Signal Processing, ICICS 2009
CountryMacao
CityMacau Fisherman's Wharf
Period8/12/0910/12/09

Keywords

  • Attentive index
  • Attentive objects
  • Image classfication
  • Image retrieval
  • Non-attentive objects
  • Saliency map

ASJC Scopus subject areas

  • Computer Networks and Communications
  • Information Systems
  • Signal Processing

Cite this