TY - GEN
T1 - HIBEY: Hide the keyboard in augmented reality
AU - Lee, Lik Hang
AU - Yung Lam, Kit
AU - Yau, Yui Pan
AU - Braud, Tristan
AU - Hui, Pan
N1 - Publisher Copyright:
© 2019 IEEE.
PY - 2019/3
Y1 - 2019/3
N2 - Text input is a very challenging task in Augmented Reality (AR). On non-touch AR headsets, virtual keyboards are counter-intuitive and character keys are hard to locate inside the constrained screen real estate. In this paper, we present the design, implementation and evaluation of HIBEY, a text input system for smartglasses. HIBEY provides a fast, reliable, affordable, and easy-to-use text entry solution through vision-based freehand interactions. Supported by a probabilistic spatial model and a language model, a three-level holographic environment enables users to apply fast and continuous hand gesture to pick characters and predictive words in a keyboardless interface. Through the pilot study and a thorough evaluations lasting 8 days, we show that HIBEY leads to a mean text entry rate of 9.95 word per minute (WPM) with 96.06% accuracy, which is comparable to other state-of-the-art approaches. After 8 days, participants can achieve an average of 13.19 WPM. In addition, HIBEY only occupies 13.14% of the screen real estate at the edge region, which is 62.80% smaller than the default keyboard layout on Microsoft Hololens.
AB - Text input is a very challenging task in Augmented Reality (AR). On non-touch AR headsets, virtual keyboards are counter-intuitive and character keys are hard to locate inside the constrained screen real estate. In this paper, we present the design, implementation and evaluation of HIBEY, a text input system for smartglasses. HIBEY provides a fast, reliable, affordable, and easy-to-use text entry solution through vision-based freehand interactions. Supported by a probabilistic spatial model and a language model, a three-level holographic environment enables users to apply fast and continuous hand gesture to pick characters and predictive words in a keyboardless interface. Through the pilot study and a thorough evaluations lasting 8 days, we show that HIBEY leads to a mean text entry rate of 9.95 word per minute (WPM) with 96.06% accuracy, which is comparable to other state-of-the-art approaches. After 8 days, participants can achieve an average of 13.19 WPM. In addition, HIBEY only occupies 13.14% of the screen real estate at the edge region, which is 62.80% smaller than the default keyboard layout on Microsoft Hololens.
KW - Character input
KW - Freehand interaction
KW - Smartglasses
KW - Three-dimensional spatial interaction
KW - Vision-based approach
UR - http://www.scopus.com/inward/record.url?scp=85070229562&partnerID=8YFLogxK
U2 - 10.1109/PERCOM.2019.8767420
DO - 10.1109/PERCOM.2019.8767420
M3 - Conference article published in proceeding or book
AN - SCOPUS:85070229562
SN - 9781538691496
T3 - 2019 IEEE International Conference on Pervasive Computing and Communications, PerCom 2019
BT - 2019 IEEE International Conference on Pervasive Computing and Communications, PerCom 2019
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - IEEE International Conference on Pervasive Computing and Communications (PerCom 2019)
Y2 - 11 March 2019 through 15 March 2019
ER -