Real-time video stylization using spatial-temporal gabor filtering

Rui Wang, Ping Li, Bin Sheng, Hanqiu Sun, Enhua Wu

Research output: Chapter in book / Conference proceedingConference article published in proceeding or bookAcademic researchpeer-review

Abstract

This paper describes a new video stylization approach that achieves non-photorealistic rendering effects by using highly efficient spatial-temporal Gabor filtering. An edge extraction algorithm is developed to detect long coherent edges, to which the human visual system is sensitive. A nonlinear diffusion is then applied to remove unimportant details. Our approach extends the optical flow computation for constructing the Gabor flow to represent pixel similarity, and to preserve the temporal coherence when applied to video sequences. In particular, our video stylization is designed in a spatiotemporal manner to achieve temporal coherence in resulting animations. Real-time performance is achieved through the highly parallel implementation on modern graphics hardware (GPU). Therefore, our video stylization can be naturally applied to real-time video communication and interactive video-based rendering. The experimental results have demonstrated the high-quality production of our real-time video stylization.

Original languageEnglish
Title of host publicationProceedings - VRCAI 2016
Subtitle of host publication15th ACM SIGGRAPH Conference on Virtual-Reality Continuum and Its Applications in Industry
EditorsStephen N. Spencer
PublisherAssociation for Computing Machinery, Inc
Pages299-307
Number of pages9
ISBN (Electronic)9781450346924
DOIs
Publication statusPublished - 3 Dec 2016
Externally publishedYes
Event15th ACM SIGGRAPH Conference on Virtual-Reality Continuum and Its Applications in Industry, VRCAI 2016 - Zhuhai, China
Duration: 3 Dec 20164 Dec 2016

Publication series

NameProceedings - VRCAI 2016: 15th ACM SIGGRAPH Conference on Virtual-Reality Continuum and Its Applications in Industry
Volume1

Conference

Conference15th ACM SIGGRAPH Conference on Virtual-Reality Continuum and Its Applications in Industry, VRCAI 2016
CountryChina
CityZhuhai
Period3/12/164/12/16

Keywords

  • Feature space
  • Gabor flow
  • Spatial-temporal processing
  • Temporal coherence
  • Video stylization

ASJC Scopus subject areas

  • Artificial Intelligence
  • Computer Science Applications
  • Computer Graphics and Computer-Aided Design
  • Computer Vision and Pattern Recognition

Cite this