Rushes video summarization using audio-visual information and sequence alignment

Yang Liu, Yan Liu, Tongwei Ren, Chun Chung Chan

Research output: Chapter in book / Conference proceedingConference article published in proceeding or bookAcademic researchpeer-review

11 Citations (Scopus)

Abstract

This paper describes our system and methodologies for the BBC rushes video summarization task of TRECVID 2008. The procedure of the system is composed of three major steps: shot detection, irrelevant and repetitive subshot removal, and final summary generation. First, we segment the original rushes video into subshots according to the difference and accumulative difference of local color histogram between consecutive frames. Second, we recognize the irrelevant subshots, such as subshots of color bar, pure gray frames, and clapper board. We propose a novel video sequence alignment algorithm to detect repetitive subshots. After removing the irrelevant and repetitive subshots, we generate the final summary using the remaining informative and representative subshots. The evaluation from TRECVID 2008 shows that our system can generate good video summaries.
Original languageEnglish
Title of host publicationTRECVid Video Summarization Workshop, TVS'08, Co-located with the 2008 ACM International Conference on Multimedia, MM'08
Pages114-118
Number of pages5
DOIs
Publication statusPublished - 1 Dec 2008
EventTRECVid Video Summarization Workshop, TVS'08, Co-located with the 2008 ACM International Conference on Multimedia, MM'08 - Vancouver, BC, United States
Duration: 27 Oct 200831 Oct 2008

Conference

ConferenceTRECVid Video Summarization Workshop, TVS'08, Co-located with the 2008 ACM International Conference on Multimedia, MM'08
Country/TerritoryUnited States
CityVancouver, BC
Period27/10/0831/10/08

Keywords

  • Rushes Editing
  • TRECVID
  • Video Summarization

ASJC Scopus subject areas

  • Computer Graphics and Computer-Aided Design
  • Computer Vision and Pattern Recognition
  • Software

Cite this