Reflection removal based on single light field capture

Yun Ni, Jie Chen, Lap Pui Chau

Research output: Chapter in book / Conference proceedingConference article published in proceeding or bookAcademic researchpeer-review

10 Citations (Scopus)

Abstract

Photography through reflective surfaces suffers from the obstruction of reflections, which deteriorates the visibility of background targets and causes challenges for subsequent computer vision applications. In this paper, we propose a novel reflection removal algorithm using light field (LF) cameras. Unlike conventional cameras, LF cameras capture extra directional information of incoming rays which enable our algorithm to remove reflections with only a single shot. We analyze the optical geometry of the background and reflection imagery in a LF camera, and generalize a set of rules that could facilitate our algorithm to differentiate the edges from different optical sources. We show that the proposed method produces significantly better reflection removal results based on the LF data as compared to traditional methods based on multiple-shot image sequences as input.

Original languageEnglish
Title of host publicationIEEE International Symposium on Circuits and Systems
Subtitle of host publicationFrom Dreams to Innovation, ISCAS 2017 - Conference Proceedings
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781467368520
DOIs
Publication statusPublished - 25 Sep 2017
Externally publishedYes
Event50th IEEE International Symposium on Circuits and Systems, ISCAS 2017 - Baltimore, United States
Duration: 28 May 201731 May 2017

Publication series

NameProceedings - IEEE International Symposium on Circuits and Systems
ISSN (Print)0271-4310

Conference

Conference50th IEEE International Symposium on Circuits and Systems, ISCAS 2017
Country/TerritoryUnited States
CityBaltimore
Period28/05/1731/05/17

Keywords

  • Epipolar Images
  • Light Field
  • Reflection

ASJC Scopus subject areas

  • Electrical and Electronic Engineering

Cite this