Hand Gesture Recognition with Augmented Reality and Leap Motion Controller

Jiage Huo, K. L. Keung, C. K.M. Lee, H. Y. Ng

Research output: Chapter in book / Conference proceedingConference article published in proceeding or bookAcademic researchpeer-review

1 Citation (Scopus)

Abstract

The use of hand gestures is one of the commonly used communication approaches in human daily life, especially for the deaf and dumb. Hand gesture recognition can be adopted in human-computer interaction for converting hand gestures into words or sentences. Unfortunately, the same gesture may have diverse meanings in different countries. With the aim of eliminating the communication barriers between hearing-impaired communities and the general people, an efficient interaction user interface created with the augmented reality technique and leap motion controller for hand gesture recognition and translation is proposed in this paper. Five hand gestures captured by a leap motion controller were used for learning and recognizing through machine learning methodologies, including Support Vector Machine, K-Nearest Neighbor, Convolutional Neural Network, Deep Neural Network and Decision Tree. The experimental results from different classifiers reveal the practicability of employing hand gesture recognition in text translation. The hand gesture recognition system should be capable of reducing the communication gap between hearing disabilities and the public so as to avoid deaf and mute people being isolated from society.

Original languageEnglish
Title of host publication2021 IEEE International Conference on Industrial Engineering and Engineering Management, IEEM 2021
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages1015-1019
Number of pages5
ISBN (Electronic)9781665437714
DOIs
Publication statusPublished - Dec 2021
Event2021 IEEE International Conference on Industrial Engineering and Engineering Management, IEEM 2021 - Virtual, Online, Singapore
Duration: 13 Dec 202116 Dec 2021

Publication series

Name2021 IEEE International Conference on Industrial Engineering and Engineering Management, IEEM 2021

Conference

Conference2021 IEEE International Conference on Industrial Engineering and Engineering Management, IEEM 2021
Country/TerritorySingapore
CityVirtual, Online
Period13/12/2116/12/21

Keywords

  • Hand gesture recognition
  • Leap motion controller
  • Machine learning

ASJC Scopus subject areas

  • Strategy and Management
  • Artificial Intelligence
  • Computer Science Applications
  • Information Systems and Management
  • Industrial and Manufacturing Engineering
  • Control and Optimization

Fingerprint

Dive into the research topics of 'Hand Gesture Recognition with Augmented Reality and Leap Motion Controller'. Together they form a unique fingerprint.

Cite this