Tipoint: Detecting fingertip for mid-air interaction on computational resource constrained smartglasses

Lik Hang Lee, Tristan Braud, Farshid Hassani Bijarbooneh, Pan Hui

Research output: Chapter in book / Conference proceedingConference article published in proceeding or bookAcademic researchpeer-review

18 Citations (Scopus)

Abstract

Smartglasses mostly rely on hardware interfaces such as touchpad and buttons, which are often cumbersome and counter-intuitive to use. Furthermore, smartglasses feature cheap and low-power hardware preventing the use of advanced pointing techniques. To overcome these issues, we introduce TiPoint, a freehand mid-air interaction technique. TiPoint uses the monocular camera embedded in smartglasses to detect the user’s hand, enabling intuitive and non-intrusive interaction. We introduce a light-weight algorithm for fingertip detection, which is especially suited for the limited hardware specifications and the short battery life time of smartglasses. Our evaluation shows that TiPoint as a mid-air non-intrusive interface delivers a better experience for users and smart glasses interactions, with users completing typical tasks 1.82 times faster than when using the original hardware.

Original languageEnglish
Title of host publicationISWC 2019 - Proceedings of the 2019 ACM International Symposium on Wearable Computers
PublisherAssociation for Computing Machinery
Pages118-122
Number of pages5
ISBN (Electronic)9781450368704
DOIs
Publication statusPublished - 9 Sept 2019
Externally publishedYes
Event23rd International Symposium on Wearable Computers, ISWC 2019 - London, United Kingdom
Duration: 9 Sept 201913 Sept 2019

Publication series

NameProceedings - International Symposium on Wearable Computers, ISWC
ISSN (Print)1550-4816

Conference

Conference23rd International Symposium on Wearable Computers, ISWC 2019
Country/TerritoryUnited Kingdom
CityLondon
Period9/09/1913/09/19

Keywords

  • Computer vision
  • Direct Manipulation
  • Gestural Interaction
  • Smart Glasses Interface

ASJC Scopus subject areas

  • Software
  • Hardware and Architecture
  • Computer Networks and Communications

Fingerprint

Dive into the research topics of 'Tipoint: Detecting fingertip for mid-air interaction on computational resource constrained smartglasses'. Together they form a unique fingerprint.

Cite this