A Human-Robot Interaction for a Mecanum Wheeled Mobile Robot with Real-Time 3D Two-Hand Gesture Recognition

Research output: Journal article publicationConference articleAcademic researchpeer-review

Abstract

Human interaction with mobile robot becomes a popular research area and its applications are widely used in industrial, commercial and military fields. A two-hand gesture recognition method with depth camera is presented for real-time controlling the mecanum wheeled mobile robot. Seven different gestures could be recognized from one hand for mobile robot navigation and three gestures could be recognized from the other hand for controlling the gripper installed on the robot. Under the proposed control scheme, the mobile robot system can be navigated and can be operated at the same time for achieving missions by two different groups of hand gestures. The accuracy of the gesture recognition is about 94%. During mobile robot control experiment, the system works timely, accurately and stably for certain tasks such as directional movement, grasping and cleaning obstacles.

Original languageEnglish
Article number012056
JournalJournal of Physics: Conference Series
Volume1267
Issue number1
DOIs
Publication statusPublished - 17 Jul 2019
Externally publishedYes
Event2019 3rd International Conference on Artificial Intelligence, Automation and Control Technologies, AIACT 2019 - Xi'an, China
Duration: 25 Apr 201927 Apr 2019

ASJC Scopus subject areas

  • General Physics and Astronomy

Fingerprint

Dive into the research topics of 'A Human-Robot Interaction for a Mecanum Wheeled Mobile Robot with Real-Time 3D Two-Hand Gesture Recognition'. Together they form a unique fingerprint.

Cite this