TY - GEN
T1 - KeyFlow
T2 - 37th Annual ACM Symposium on User Interface Software and Technology, UIST Adjunct 2024
AU - Liu, Yujia
AU - Shan, Qihang
AU - Yao, Zhihao
AU - Lu, Qiuyu
N1 - Publisher Copyright:
© 2024 Copyright held by the owner/author(s).
PY - 2024/10/13
Y1 - 2024/10/13
N2 - Despite typing being a critical operation in the digital age, users still need to frequently switch between the mouse and keyboard while typing. We introduce KeyFlow, a tool that integrates mouse functionality into the keyboard through machine learning, allowing users to glide their fingers across the keyboard surface to move the cursor. The whole process does not press the keys down to differentiate from normal typing and avoid false touches. KeyFlow uses any computer-built-in microphones to capture the acoustic features of these gliding gestures, requiring no specialized equipment and can be set up and tested independently within 5 minutes. Our user research indicates that, compared to traditional keyboard and mouse methods, this system reduces hand movement distance by 78.3%, making the typing experience more focused.
AB - Despite typing being a critical operation in the digital age, users still need to frequently switch between the mouse and keyboard while typing. We introduce KeyFlow, a tool that integrates mouse functionality into the keyboard through machine learning, allowing users to glide their fingers across the keyboard surface to move the cursor. The whole process does not press the keys down to differentiate from normal typing and avoid false touches. KeyFlow uses any computer-built-in microphones to capture the acoustic features of these gliding gestures, requiring no specialized equipment and can be set up and tested independently within 5 minutes. Our user research indicates that, compared to traditional keyboard and mouse methods, this system reduces hand movement distance by 78.3%, making the typing experience more focused.
KW - Gesture Recognition
KW - Keyboard
KW - Machine Learning
KW - Passive Acoustic Sensing
KW - Typing Experience
UR - https://www.scopus.com/pages/publications/85211446198
U2 - 10.1145/3672539.3686348
DO - 10.1145/3672539.3686348
M3 - Conference article published in proceeding or book
AN - SCOPUS:85211446198
T3 - UIST Adjunct 2024 - Proceedings of the 37th Annual ACM Symposium on User Interface Software and Technology
BT - UIST Adjunct 2024 - Proceedings of the 37th Annual ACM Symposium on User Interface Software and Technology
PB - Association for Computing Machinery, Inc
Y2 - 13 October 2024 through 16 October 2024
ER -