Dimensionality reduction for descriptor generation in rushes editing

Yang Liu, Yan Liu, Chun Chung Chan

Research output: Chapter in book / Conference proceedingConference article published in proceeding or bookAcademic researchpeer-review

Abstract

Rushes editing, which enables the computer to edit the film like a professional film cutter based on the noisy and redundant footage, is an active topic in multimedia semantic analysis. The most critical problem of rushes editing is how to generate an effective, efficient, and robust descriptor for the footage content analysis. This paper proposes a novel non-linear dimensionality reduction algorithm called Multi-Layer Isometric Feature Mapping (ML-Isomap) for automatic descriptor generation. First, a K-nearest Neighbor Based Clustering (KNBC) algorithm is utilized to partition the high-dimensional data points into a set of data blocks. Second, intra-cluster graphs are constructed based on the individual character of each data block to build the basic layer for the ML-Isomap. Third, the inter-cluster graph is constructed by analyzing the interrelation among these isolated data blocks to build the hyper-layers for the ML-Isomap. Finally, all the data points are mapped into the unique low-dimensional feature space by keeping the corresponding relations of the multiple layers in the high-dimensional feature space to the greatest extent. The comparative experiments on synthetic data as well as the real rushes editing tasks demonstrate that the proposed algorithm can generate the effective descriptor with much lower dimensions for the semantic video analysis.
Original languageEnglish
Title of host publicationProceedings - IEEE International Conference on Semantic Computing 2008, ICSC 2008
Pages104-111
Number of pages8
DOIs
Publication statusPublished - 25 Sep 2008
Event2nd Annual IEEE International Conference on Semantic Computing, ICSC 2008 - Santa Clara, CA, United States
Duration: 4 Aug 20087 Aug 2008

Conference

Conference2nd Annual IEEE International Conference on Semantic Computing, ICSC 2008
Country/TerritoryUnited States
CitySanta Clara, CA
Period4/08/087/08/08

ASJC Scopus subject areas

  • Artificial Intelligence
  • Software

Cite this