Light field scene flow with occlusion regularization

Jie Chen, Yun Ni, Juhui Hou, Lap Pui Chau

Research output: Chapter in book / Conference proceedingConference article published in proceeding or bookAcademic researchpeer-review

Abstract

The scene flow provides a comprehensive understanding of the vision field's 3D dynamics, which is extremely useful for most computer vision applications. Stereo vision has been the conventional means for scene flow estimation. However, light field camera provides a more convenient and reliable solution for the same task with its unique advantage in scene depth estimation. In this work, we propose a joint estimation framework for the optical flow and depth flow given two light field images as input. The scene depth estimated from the light field will be used for occlusion detection and sparse correspondence regularization which results in a more robust estimation of optical flow. Depth flow will be calculated based on the interpolated correspondence matching. Experiments show that the proposed framework can produce competitive scene flow estimation at a much lower computational cost, compared to state-of-The-Art methods.

Original languageEnglish
Title of host publicationProceedings - 9th Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA ASC 2017
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages1148-1151
Number of pages4
ISBN (Electronic)9781538615423
DOIs
Publication statusPublished - 5 Feb 2018
Externally publishedYes
Event9th Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA ASC 2017 - Kuala Lumpur, Malaysia
Duration: 12 Dec 201715 Dec 2017

Publication series

NameProceedings - 9th Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA ASC 2017
Volume2018-February

Conference

Conference9th Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA ASC 2017
Country/TerritoryMalaysia
CityKuala Lumpur
Period12/12/1715/12/17

Keywords

  • depth flow
  • Light field
  • occlusion
  • optical flow
  • scene flow

ASJC Scopus subject areas

  • Artificial Intelligence
  • Human-Computer Interaction
  • Information Systems
  • Signal Processing

Fingerprint

Dive into the research topics of 'Light field scene flow with occlusion regularization'. Together they form a unique fingerprint.

Cite this