Comprehending products with mixed reality: Geometric relationships and creativity

Y. M. Tang, K. M. Au, Yohana Leung

Research output: Journal article publicationJournal articleAcademic researchpeer-review

41 Citations (Scopus)


Nowadays, the virtual reality (VR) market has made significant strides. VR is widely used in different applications, and education and training are one of the leading areas which are expected to grow to US $2.2 billion in revenue by 2023. Mixed reality (MR) is also known as hybrid reality that encompasses both VR and augmented reality. It allows interaction and feedback from the users, which is particularly important to enhance the experience in teaching and learning. MR not only merges the real and virtual worlds into a new environment, which combines physical and digital content, but also allows users to interact with the digital content dynamically in real time. In support of teaching and training, MR technology has been applied in diverse manufacturing and industrial sectors to visualize the digital models. Nevertheless, most of these MR projects are mainly focused on users’ experience. The effectiveness in comprehending product design is seldom investigated. Therefore, in this project, an MR application is developed for teaching product design to university students. The application is developed on the HoloLens system. A practicable application has been designed that allows students to visualize the geometry of 3-D objects as well as the exploded diagrams of selected components. The students can command the system through the command manual or can signal the system through gazing, gesturing, and voice to implement instructions. To investigate the effectiveness of the MR application in teaching product design, a pretest and a posttest of similar difficulties were designed to access students’ abilities in five main areas: the ability of students in comprehending design, understanding product functions, visualizing 3-D geometry, understanding geometric relationship, and students’ creativity. In the investigation, 45 students were participated in the tests. Experimental results show that the proposed design positively improves students’ understanding in geometric relationships and creativity. In the future, more features will be added to the MR application to further improve students’ abilities in learning and training in other aspects.

Original languageEnglish
Article number1847979018809599
Number of pages12
JournalInternational Journal of Engineering Business Management
Publication statusPublished - 22 Nov 2018


  • creativity
  • design
  • functions
  • geometric relationships
  • HoloLens
  • mixed reality
  • product
  • teaching
  • Virtual reality

ASJC Scopus subject areas

  • Organizational Behavior and Human Resource Management
  • Management Science and Operations Research


Dive into the research topics of 'Comprehending products with mixed reality: Geometric relationships and creativity'. Together they form a unique fingerprint.

Cite this