A Novel Reflection Removal Algorithm Using the Light Field Camera

Tingtian Li, Daniel P.K. Lun

Research output: Chapter in book / Conference proceedingConference article published in proceeding or bookAcademic researchpeer-review

5 Citations (Scopus)


In daily photography, it is common that the captured images are superimposed with undesired reflection of another scene. Such reflection does not only reduce the visual quality of the target background scene, but also affects the subsequent processing on the image. Removing the reflection without any prior information of the background is a very challenging task. Traditional approaches often come with various assumptions, which are difficult to fulfil in general. In this paper, we propose a novel method to remove the reflection based on light field (LF) imaging. Via the epipolar plane image, we firstly devise a method to retrieve the depth map of the scene from an LF image. According to the depth value, the gradient points of the image are classified to belong to the background, reflection or shared layer. Finally, the background image is reconstructed from the estimated gradient points in the background and shared layers using a sparse optimization process. The proposed algorithm does not have the assumptions of the existing methods; thus, it is more robust. Experimental results show that the proposed algorithm outperforms the existing approaches both qualitatively and quantitatively.

Original languageEnglish
Title of host publication2018 IEEE International Symposium on Circuits and Systems, ISCAS 2018 - Proceedings
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781538648810
Publication statusPublished - 26 Apr 2018
Event2018 IEEE International Symposium on Circuits and Systems, ISCAS 2018 - Florence, Italy
Duration: 27 May 201830 May 2018

Publication series

NameProceedings - IEEE International Symposium on Circuits and Systems
ISSN (Print)0271-4310


Conference2018 IEEE International Symposium on Circuits and Systems, ISCAS 2018


  • image separation
  • light field
  • reflection removal

ASJC Scopus subject areas

  • Electrical and Electronic Engineering

Cite this