Image-aligned dynamic liver reconstruction using intra-operative field of views for minimal invasive surgery

Muhammad Nadeem Cheema, Anam Nazir, Bin Sheng, Ping Li, Jing Qin, Jinman Kim, David Dagan Feng

Research output: Journal article publicationJournal articleAcademic researchpeer-review

13 Citations (Scopus)


During hepatic minimal invasive surgery (MIS), 3-D reconstruction of a liver surface by interpreting the geometry of its soft tissues is achieving attractions. One of the major issues to be addressed in MIS is liver deformation. Moreover, it severely inhibits free sight and dexterity of tissue manipulation, which causes its intra-operative morphology and soft tissue motion altered as compared to its pre-operative shape. While many applications focus on 3-D reconstruction of rigid or semi-rigid scenes, the techniques applied in hepatic MIS must be able to cope with a dynamic and deformable environment. We propose an efficient technique for liver surface reconstruction based on the structure from motion to handle liver deformation. The reconstructed liver will assist surgeons to visualize liver surface more efficiently with better depth perception. We use the intra-operative field of views to generate 3-D template mesh from a dense keypoint cloud. We estimate liver deformation by finding best correspondence between 3-D templates and reconstruct a liver image to calculate translation and rotational motions. Our technique then finely tunes deformed surface by adding smoothness using shading cues. Up till now, this technique is not used for solving the human liver deformation problem. Our approach is tested and validated with synthetic as well as real in vivo data, which reveal that the reconstruction accuracy can be enhanced using our approach even in challenging laparoscopic environments.

Original languageEnglish
Pages (from-to)2163-2173
Number of pages11
JournalIEEE Transactions on Biomedical Engineering
Issue number8
Publication statusPublished - Aug 2019


  • 3D reconstruction
  • Field of view
  • Keypoint mesh
  • Liver deformation
  • Minimal invasive surgery

ASJC Scopus subject areas

  • Biomedical Engineering


Dive into the research topics of 'Image-aligned dynamic liver reconstruction using intra-operative field of views for minimal invasive surgery'. Together they form a unique fingerprint.

Cite this