Efficient image/video retexturing using parallel bilateral grids

Ping Li, Hanqiu Sun, Chen Huang, Jianbing Shen, Yongwei Nie

Research output: Chapter in book / Conference proceedingConference article published in proceeding or bookAcademic researchpeer-review

2 Citations (Scopus)

Abstract

This paper presents a feature-guided retexturing method that preserves similar underlying texture distortion between the original and the retextured images/videos. Existing image retexturing and synthesis methods deal with texture distortion by inter-pixel distances manipulation in image space, and the underlying texture distortion of the original images is always destroyed when performing the nowaday retexturing techniques due to limitations like improper distortion caused by human mesh stretching, or unavoidable texture splitting caused by synthesis. The long processing time due to time-consuming bilateral filtering is also unacceptable. We propose to utilize corner features to naturally discover the underlying texture distortion existed in the original images. Gradient-based depth map reconstruction and feature-guided optimization are then applied to accomplish the distortion process. We facilitate the HDR image/video retexturing via real-time bilateral grid and feature-guided texture distortion optimization on GPU-CUDA platform. Our retexturing using feature-guided optimization in gradient domain provides realistic retexturing of HDR images while preserving elite texture distortion in cornered area. In multiple experiments, our method consistently demonstrates high-quality performance of image/video retexturing in real time.

Original languageEnglish
Title of host publicationProceedings of VRCAI 2011
Subtitle of host publicationACM SIGGRAPH Conference on Virtual-Reality Continuum and its Applications to Industry
Pages131-140
Number of pages10
DOIs
Publication statusPublished - 1 Dec 2011
Externally publishedYes
Event10th International Conference on Virtual Reality Continuum and Its Applications in Industry, VRCAI'11 - Hong Kong, China
Duration: 11 Dec 201112 Dec 2011

Publication series

NameProceedings of VRCAI 2011: ACM SIGGRAPH Conference on Virtual-Reality Continuum and its Applications to Industry

Conference

Conference10th International Conference on Virtual Reality Continuum and Its Applications in Industry, VRCAI'11
Country/TerritoryChina
CityHong Kong
Period11/12/1112/12/11

Keywords

  • Bilateral grid
  • GPU
  • Real-time processing
  • Retexturing

ASJC Scopus subject areas

  • Artificial Intelligence
  • Computer Science Applications

Cite this