Detail-preserving and content-aware variational multi-view stereo reconstruction

Zhaoxin Li, Kuanquan Wang, Wangmeng Zuo, Deyu Meng, Lei Zhang

Research output: Journal article publicationReview articleAcademic researchpeer-review

14 Citations (Scopus)

Abstract

Accurate recovery of 3D geometrical surfaces from calibrated 2D multi-view images is a fundamental yet active research area in computer vision. Despite the steady progress in multi-view stereo (MVS) reconstruction, many existing methods are still limited in recovering fine-scale details and sharp features while suppressing noises, and may fail in reconstructing regions with less textures. To address these limitations, this paper presents a detail-preserving and content-aware variational (DCV) MVS method, which reconstructs the 3D surface by alternating between reprojection error minimization and mesh denoising. In reprojection error minimization, we propose a novel inter-image similarity measure, which is effective to preserve fine-scale details of the reconstructed surface and builds a connection between guided image filtering and image registration. In mesh denoising, we propose a content-aware p-minimization algorithm by adaptively estimating the p value and regularization parameters. Compared with conventional isotropic mesh smoothing approaches, the proposed method is much more promising in suppressing noise while preserving sharp features. Experimental results on benchmark data sets demonstrate that our DCV method is capable of recovering more surface details, and obtains cleaner and more accurate reconstructions than the state-of-the-art methods. In particular, our method achieves the best results among all published methods on the Middlebury dino ring and dino sparse data sets in terms of both completeness and accuracy.
Original languageEnglish
Article number7350114
Pages (from-to)864-877
Number of pages14
JournalIEEE Transactions on Image Processing
Volume25
Issue number2
DOIs
Publication statusPublished - 1 Feb 2016

Keywords

  • Featurepreserving
  • Mesh denoising
  • Multi-view stereo
  • Reprojection error
  • ℓ p minimization

ASJC Scopus subject areas

  • Software
  • Computer Graphics and Computer-Aided Design

Cite this