TY - GEN
T1 - Tipoint: Detecting fingertip for mid-air interaction on computational resource constrained smartglasses
AU - Lee, Lik Hang
AU - Braud, Tristan
AU - Bijarbooneh, Farshid Hassani
AU - Hui, Pan
N1 - Publisher Copyright:
© 2019 Association for Computing Machinery.
PY - 2019/9/9
Y1 - 2019/9/9
N2 - Smartglasses mostly rely on hardware interfaces such as touchpad and buttons, which are often cumbersome and counter-intuitive to use. Furthermore, smartglasses feature cheap and low-power hardware preventing the use of advanced pointing techniques. To overcome these issues, we introduce TiPoint, a freehand mid-air interaction technique. TiPoint uses the monocular camera embedded in smartglasses to detect the user’s hand, enabling intuitive and non-intrusive interaction. We introduce a light-weight algorithm for fingertip detection, which is especially suited for the limited hardware specifications and the short battery life time of smartglasses. Our evaluation shows that TiPoint as a mid-air non-intrusive interface delivers a better experience for users and smart glasses interactions, with users completing typical tasks 1.82 times faster than when using the original hardware.
AB - Smartglasses mostly rely on hardware interfaces such as touchpad and buttons, which are often cumbersome and counter-intuitive to use. Furthermore, smartglasses feature cheap and low-power hardware preventing the use of advanced pointing techniques. To overcome these issues, we introduce TiPoint, a freehand mid-air interaction technique. TiPoint uses the monocular camera embedded in smartglasses to detect the user’s hand, enabling intuitive and non-intrusive interaction. We introduce a light-weight algorithm for fingertip detection, which is especially suited for the limited hardware specifications and the short battery life time of smartglasses. Our evaluation shows that TiPoint as a mid-air non-intrusive interface delivers a better experience for users and smart glasses interactions, with users completing typical tasks 1.82 times faster than when using the original hardware.
KW - Computer vision
KW - Direct Manipulation
KW - Gestural Interaction
KW - Smart Glasses Interface
UR - http://www.scopus.com/inward/record.url?scp=85072802617&partnerID=8YFLogxK
U2 - 10.1145/3341163.3347723
DO - 10.1145/3341163.3347723
M3 - Conference article published in proceeding or book
AN - SCOPUS:85072802617
T3 - Proceedings - International Symposium on Wearable Computers, ISWC
SP - 118
EP - 122
BT - ISWC 2019 - Proceedings of the 2019 ACM International Symposium on Wearable Computers
PB - Association for Computing Machinery
T2 - 23rd International Symposium on Wearable Computers, ISWC 2019
Y2 - 9 September 2019 through 13 September 2019
ER -