Depth of field rendering using multilayer-neighborhood optimization

Benxuan Zhang, Bin Sheng, Ping Li, Tong Yee Lee

Research output: Journal article publicationJournal articleAcademic researchpeer-review

10 Citations (Scopus)


Depth of field (DOF) is utilized widely to deliver artistic effects in photography. However, existing post-processing techniques for rendering DOF effects introduce visual artifacts such as color leakage, blurring discontinuity, and the partial occlusion problems which limit the application of DOF. Traditionally, occluded pixels are ignored or not well estimated although they might make key contributions to images. In this paper, we propose a new filtering approach which takes approximated occluded pixels into account to synthesize the DOF effects for images. In our approach, images are separated into different layers based on depth. Besides, we utilize adaptive PatchMatch method to estimate the intensities of occluded pixels, especially in the background region. We again propose a new multilayer-neighborhood optimization to estimate occluded pixels contributions and render the images. Finally, we apply gathering filter to achieve the rendered images with elite DOF effects. Multiple experiments have shown that our approach can handle color leakage, blurring discontinuity and partial occlusion problem while providing high-quality DOF rendering effects.

Original languageEnglish
Pages (from-to)2546-2559
Number of pages14
JournalIEEE Transactions on Visualization and Computer Graphics
Issue number8
Publication statusPublished - Aug 2020
Externally publishedYes


  • Depth of field
  • multilayer
  • neighborhood optimization
  • rendering

ASJC Scopus subject areas

  • Software
  • Signal Processing
  • Computer Vision and Pattern Recognition
  • Computer Graphics and Computer-Aided Design


Dive into the research topics of 'Depth of field rendering using multilayer-neighborhood optimization'. Together they form a unique fingerprint.

Cite this