3DeformR: freehand 3D model editing in virtual environments considering head movements on mobile headsets

Kit Yung Lam, Lik Hang Lee, Pan Hui

Research output: Chapter in book / Conference proceedingConference article published in proceeding or bookAcademic researchpeer-review

4 Citations (Scopus)

Abstract

3D objects are the primary media in virtual reality environments in immersive cyberspace, also known as the Metaverse. Users, through editing such objects, can communicate with other individuals on mobile headsets. Knowing that the tangible controllers cause the burden to carry such addendum devices, the body-centric interaction techniques, such as hand gestures, get rid of such burdens. However, object editing with hand gestures is usually overlooked. Accordingly, we propose and implement a palm-based virtual embodiment for hand gestural model editing, namely 3DeformR. We employ three optimized hand gestures on bi-harmonic deformation algorithms that enable selecting and editing 3D models in fine granularity. Our evaluation with nine participants considers three interaction techniques (two-handed tangible controller (OMC), a naive implementation of hand gestures (SH), and 3DeformR. Two experimental tasks of planar and spherical objects imply that 3DeformR outperforms SH, in terms of task completion time (∼51%) and required actions (∼17%). Also, our participants with 3DeformR make significantly better performance than the commercial standard (OMC) - saved task time (∼43%) and actions (∼3%). Remarkably, the edited objects by 3DeformR show no discernible difference from those with tangible controllers characterised by accurate and responsive detection.

Original languageEnglish
Title of host publicationMMSys 2022 - Proceedings of the 13th ACM Multimedia Systems Conference
PublisherAssociation for Computing Machinery, Inc
Pages52-61
Number of pages10
ISBN (Electronic)9781450392839
DOIs
Publication statusPublished - 14 Jun 2022
Externally publishedYes
Event13th ACM Multimedia Systems Conference, MMSys 2022 - Athlone, Ireland
Duration: 14 Jun 202217 Jun 2022

Publication series

NameMMSys 2022 - Proceedings of the 13th ACM Multimedia Systems Conference

Conference

Conference13th ACM Multimedia Systems Conference, MMSys 2022
Country/TerritoryIreland
CityAthlone
Period14/06/2217/06/22

Keywords

  • 3D authoring
  • 3D modeling
  • Authoring tools
  • Hand gestures
  • the Metaverse
  • Virtual reality

ASJC Scopus subject areas

  • Computer Graphics and Computer-Aided Design
  • Human-Computer Interaction
  • Software

Fingerprint

Dive into the research topics of '3DeformR: freehand 3D model editing in virtual environments considering head movements on mobile headsets'. Together they form a unique fingerprint.

Cite this