Multi-modal information retrieval with a semantic view mechanism

L. I. Qing, Jun Yang, Yueting Zhuang

Research output: Chapter in book / Conference proceedingConference article published in proceeding or bookAcademic researchpeer-review

3 Citations (Scopus)

Abstract

The explosive growth of multimedia information on the Web in recent years calls for an elegant means to model and manage multimedia content to facilitate semantic-level access and sharing across diversified applications. From the perspective of retrieval, the semantics of multimedia data features context-dependency and media-independency; both are inadequately supported by the state-of-the-art data modeling technology. In this paper, we address this problem by advocating MediaView as an extended object-oriented view mechanism to bridge the "semantic gap" between conventional databases and semantics-intensive multimedia applications. This mechanism captures the dynamic semantics of multimedia using a modeling construct named media view (MV), which formulates a customized context where heterogeneous media objects with similar/related semantics are characterized by additional properties and user-defined semantic relationships. View operators are proposed for the manipulation and derivation of individual MVs which can be fit into the desired real-life scenarios automatically. The usefulness and elegancy of MediaView are demonstrated by its applications in various (subjective) activities supporting multi-modal retrieval.

Original languageEnglish
Title of host publicationProceedings - 19th International Conference on Advanced Information Networking and Applications, AINA 2005
Pages133-138
Number of pages6
DOIs
Publication statusPublished - 1 Dec 2005
Externally publishedYes
Event19th International Conference on Advanced Information Networking and Applications, AINA 2005 - Taipei, Taiwan
Duration: 28 Mar 200530 Mar 2005

Publication series

NameProceedings - International Conference on Advanced Information Networking and Applications, AINA
Volume1
ISSN (Print)1550-445X

Conference

Conference19th International Conference on Advanced Information Networking and Applications, AINA 2005
Country/TerritoryTaiwan
CityTaipei
Period28/03/0530/03/05

Keywords

  • Context-dependency
  • Media view
  • Multi-modal retrieval

ASJC Scopus subject areas

  • Engineering(all)

Cite this