Rushes video summarization using audio-visual information and sequence alignment

Yang Liu; Yan Liu; Tongwei Ren; Chun Chung Chan

doi:10.1145/1463563.1463584

Rushes video summarization using audio-visual information and sequence alignment

Yang Liu, Yan Liu, Tongwei Ren, Chun Chung Chan

Research output: Chapter in book / Conference proceeding › Conference article published in proceeding or book › Academic research › peer-review

12 Citations (Scopus)

Abstract

This paper describes our system and methodologies for the BBC rushes video summarization task of TRECVID 2008. The procedure of the system is composed of three major steps: shot detection, irrelevant and repetitive subshot removal, and final summary generation. First, we segment the original rushes video into subshots according to the difference and accumulative difference of local color histogram between consecutive frames. Second, we recognize the irrelevant subshots, such as subshots of color bar, pure gray frames, and clapper board. We propose a novel video sequence alignment algorithm to detect repetitive subshots. After removing the irrelevant and repetitive subshots, we generate the final summary using the remaining informative and representative subshots. The evaluation from TRECVID 2008 shows that our system can generate good video summaries.

Original language	English
Title of host publication	TRECVid Video Summarization Workshop, TVS'08, Co-located with the 2008 ACM International Conference on Multimedia, MM'08
Pages	114-118
Number of pages	5
DOIs	https://doi.org/10.1145/1463563.1463584
Publication status	Published - 1 Dec 2008
Event	TRECVid Video Summarization Workshop, TVS'08, Co-located with the 2008 ACM International Conference on Multimedia, MM'08 - Vancouver, BC, United States Duration: 27 Oct 2008 → 31 Oct 2008

Conference

Conference	TRECVid Video Summarization Workshop, TVS'08, Co-located with the 2008 ACM International Conference on Multimedia, MM'08
Country/Territory	United States
City	Vancouver, BC
Period	27/10/08 → 31/10/08

Keywords

Rushes Editing
TRECVID
Video Summarization

ASJC Scopus subject areas

Computer Graphics and Computer-Aided Design
Computer Vision and Pattern Recognition
Software

More information

10.1145/1463563.1463584

Cite this

@inproceedings{effe05576e6c4a95b3ef72fd0a0fe1fc,

title = "Rushes video summarization using audio-visual information and sequence alignment",

abstract = "This paper describes our system and methodologies for the BBC rushes video summarization task of TRECVID 2008. The procedure of the system is composed of three major steps: shot detection, irrelevant and repetitive subshot removal, and final summary generation. First, we segment the original rushes video into subshots according to the difference and accumulative difference of local color histogram between consecutive frames. Second, we recognize the irrelevant subshots, such as subshots of color bar, pure gray frames, and clapper board. We propose a novel video sequence alignment algorithm to detect repetitive subshots. After removing the irrelevant and repetitive subshots, we generate the final summary using the remaining informative and representative subshots. The evaluation from TRECVID 2008 shows that our system can generate good video summaries.",

keywords = "Rushes Editing, TRECVID, Video Summarization",

author = "Yang Liu and Yan Liu and Tongwei Ren and Chan, {Chun Chung}",

year = "2008",

month = dec,

day = "1",

doi = "10.1145/1463563.1463584",

language = "English",

isbn = "9781605583099",

pages = "114--118",

booktitle = "TRECVid Video Summarization Workshop, TVS'08, Co-located with the 2008 ACM International Conference on Multimedia, MM'08",

note = "TRECVid Video Summarization Workshop, TVS'08, Co-located with the 2008 ACM International Conference on Multimedia, MM'08 ; Conference date: 27-10-2008 Through 31-10-2008",

}

Liu, Y, Liu, Y, Ren, T & Chan, CC 2008, Rushes video summarization using audio-visual information and sequence alignment. in TRECVid Video Summarization Workshop, TVS'08, Co-located with the 2008 ACM International Conference on Multimedia, MM'08. pp. 114-118, TRECVid Video Summarization Workshop, TVS'08, Co-located with the 2008 ACM International Conference on Multimedia, MM'08, Vancouver, BC, United States, 27/10/08. https://doi.org/10.1145/1463563.1463584

Rushes video summarization using audio-visual information and sequence alignment. / Liu, Yang; Liu, Yan; Ren, Tongwei et al.
TRECVid Video Summarization Workshop, TVS'08, Co-located with the 2008 ACM International Conference on Multimedia, MM'08. 2008. p. 114-118.

Research output: Chapter in book / Conference proceeding › Conference article published in proceeding or book › Academic research › peer-review

TY - GEN

T1 - Rushes video summarization using audio-visual information and sequence alignment

AU - Liu, Yang

AU - Liu, Yan

AU - Ren, Tongwei

AU - Chan, Chun Chung

PY - 2008/12/1

Y1 - 2008/12/1

N2 - This paper describes our system and methodologies for the BBC rushes video summarization task of TRECVID 2008. The procedure of the system is composed of three major steps: shot detection, irrelevant and repetitive subshot removal, and final summary generation. First, we segment the original rushes video into subshots according to the difference and accumulative difference of local color histogram between consecutive frames. Second, we recognize the irrelevant subshots, such as subshots of color bar, pure gray frames, and clapper board. We propose a novel video sequence alignment algorithm to detect repetitive subshots. After removing the irrelevant and repetitive subshots, we generate the final summary using the remaining informative and representative subshots. The evaluation from TRECVID 2008 shows that our system can generate good video summaries.

AB - This paper describes our system and methodologies for the BBC rushes video summarization task of TRECVID 2008. The procedure of the system is composed of three major steps: shot detection, irrelevant and repetitive subshot removal, and final summary generation. First, we segment the original rushes video into subshots according to the difference and accumulative difference of local color histogram between consecutive frames. Second, we recognize the irrelevant subshots, such as subshots of color bar, pure gray frames, and clapper board. We propose a novel video sequence alignment algorithm to detect repetitive subshots. After removing the irrelevant and repetitive subshots, we generate the final summary using the remaining informative and representative subshots. The evaluation from TRECVID 2008 shows that our system can generate good video summaries.

KW - Rushes Editing

KW - TRECVID

KW - Video Summarization

UR - http://www.scopus.com/inward/record.url?scp=77950501558&partnerID=8YFLogxK

U2 - 10.1145/1463563.1463584

DO - 10.1145/1463563.1463584

M3 - Conference article published in proceeding or book

SN - 9781605583099

SP - 114

EP - 118

BT - TRECVid Video Summarization Workshop, TVS'08, Co-located with the 2008 ACM International Conference on Multimedia, MM'08

T2 - TRECVid Video Summarization Workshop, TVS'08, Co-located with the 2008 ACM International Conference on Multimedia, MM'08

Y2 - 27 October 2008 through 31 October 2008

ER -

Rushes video summarization using audio-visual information and sequence alignment

Abstract

Conference

Keywords

ASJC Scopus subject areas

More information

Other files and links

Fingerprint

Cite this