Multiview-coherent disocclusion synthesis using connected regions optimization

Ping Li, Yuxi Jin, Bin Sheng, Di Lin, Yongwei Nie, Enhua Wu

Research output: Journal article publicationJournal articleAcademic researchpeer-review

Abstract

Handling of missing areas is a key step for depth-based rendering to synthesize virtual views. Existing methods usually consider finding candidate pixels from only one reference view to fill missing areas. However, the information provided by one reference view is restricted by the position of the view. By utilizing two reference views located on both the left and right sides of the virtual view, we propose to synthesize the missing areas at hole level with connected regions optimization. To avoid the appearance of ghost boundary, we apply morphological operations to generate a boundary band map for the depth map, which restricts the warping of the virtual view. We use a binary map to mark unknown pixels in a hole, label the connected unknown regions, and count the area of each connected region, which decide the order in our enhanced inpainting synthesis. Besides, we separate the foreground and background regions of the depth map to constrain the searching of candidate pixels. Multiple experiments on virtual view synthesis have shown the effectiveness and high quality of our multiview-coherent disocclusion synthesis.

Original languageEnglish
Article numbere1894
JournalComputer Animation and Virtual Worlds
Volume30
Issue number3-4
DOIs
Publication statusPublished - 1 May 2019

Keywords

  • coherent
  • connected regions
  • disocclusion synthesis
  • multiview

ASJC Scopus subject areas

  • Software
  • Computer Graphics and Computer-Aided Design

Cite this