Multiview-coherent disocclusion synthesis using connected regions optimization

Ping Li, Yuxi Jin, Bin Sheng, Di Lin, Yongwei Nie, Enhua Wu

Research output: Journal article publicationJournal articleAcademic researchpeer-review


Handling of missing areas is a key step for depth-based rendering to synthesize virtual views. Existing methods usually consider finding candidate pixels from only one reference view to fill missing areas. However, the information provided by one reference view is restricted by the position of the view. By utilizing two reference views located on both the left and right sides of the virtual view, we propose to synthesize the missing areas at hole level with connected regions optimization. To avoid the appearance of ghost boundary, we apply morphological operations to generate a boundary band map for the depth map, which restricts the warping of the virtual view. We use a binary map to mark unknown pixels in a hole, label the connected unknown regions, and count the area of each connected region, which decide the order in our enhanced inpainting synthesis. Besides, we separate the foreground and background regions of the depth map to constrain the searching of candidate pixels. Multiple experiments on virtual view synthesis have shown the effectiveness and high quality of our multiview-coherent disocclusion synthesis.

Original languageEnglish
Article numbere1894
Pages (from-to)1-12
JournalComputer Animation and Virtual Worlds
Issue number3-4
Publication statusPublished - Aug 2019


  • coherent
  • connected regions
  • disocclusion synthesis
  • multiview

ASJC Scopus subject areas

  • Software
  • Computer Graphics and Computer-Aided Design


Dive into the research topics of 'Multiview-coherent disocclusion synthesis using connected regions optimization'. Together they form a unique fingerprint.

Cite this