Voxelized facial reconstruction using deep neural network

Xiaoshuang Li, Bin Sheng, Ping Li, Jinman Kim, David Dagan Feng

Research output: Chapter in book / Conference proceedingConference article published in proceeding or bookAcademic researchpeer-review

Abstract

This paper presents an approach to predicting variation tendency of human faces with regard to cranium changes based on deep learning. Our work focuses on generating individual customized facial models with high plausibility. Inspired by the performance of encoder-decoder convolutional neural network, the core trainable predicting engine of our learning network is designed for three-dimension voxelized data representation as the encoder-decoder structure and the encoder part is similar to the 7 layers of VGG16 network. To take full consideration of the cranium changes and features of original human face, a novel formation of channeled volumetric data structure is presented, and also the corresponding sub and up-sampling strategies for volume data. Our encoder-decoder neural network consumes discrete 3-channel volume data and generates 1-channel volume data as predicted post-variation human face. This framework is quantified with clinical dataset and it shows that its' performance improves in comparison with the state-of-the-art technologies.

Original languageEnglish
Title of host publicationProceedings of Computer Graphics International, CGI 2018
PublisherAssociation for Computing Machinery
Pages1-4
Number of pages4
ISBN (Electronic)1595930361, 9781450364010
DOIs
Publication statusPublished - 11 Jun 2018
Externally publishedYes
Event2018 Computer Graphics International Conference, CGI 2018 - Bintan, Indonesia
Duration: 11 Jun 201814 Jun 2018

Publication series

NameACM International Conference Proceeding Series

Conference

Conference2018 Computer Graphics International Conference, CGI 2018
Country/TerritoryIndonesia
CityBintan
Period11/06/1814/06/18

Keywords

  • 3D reconstruction
  • Deep learning
  • Facial reconstruction

ASJC Scopus subject areas

  • Software
  • Human-Computer Interaction
  • Computer Vision and Pattern Recognition
  • Computer Networks and Communications

Cite this