Skip to main navigation Skip to search Skip to main content

KeyFlow: Acoustic Motion Sensing for Cursor Control on Any Keyboard

  • Yujia Liu
  • , Qihang Shan
  • , Zhihao Yao
  • , Qiuyu Lu

Research output: Chapter in book / Conference proceeding › Conference article published in proceeding or book › Academic research › peer-review

Abstract

Despite typing being a critical operation in the digital age, users still need to frequently switch between the mouse and keyboard while typing. We introduce KeyFlow, a tool that integrates mouse functionality into the keyboard through machine learning, allowing users to glide their fingers across the keyboard surface to move the cursor. The whole process does not press the keys down to differentiate from normal typing and avoid false touches. KeyFlow uses any computer-built-in microphones to capture the acoustic features of these gliding gestures, requiring no specialized equipment and can be set up and tested independently within 5 minutes. Our user research indicates that, compared to traditional keyboard and mouse methods, this system reduces hand movement distance by 78.3%, making the typing experience more focused.

Original languageEnglish
Title of host publicationUIST Adjunct 2024 - Proceedings of the 37th Annual ACM Symposium on User Interface Software and Technology
PublisherAssociation for Computing Machinery, Inc
ISBN (Electronic)9798400707186
DOIs
Publication statusPublished - 13 Oct 2024
Externally publishedYes
Event37th Annual ACM Symposium on User Interface Software and Technology, UIST Adjunct 2024 - Pittsburgh, United States
Duration: 13 Oct 2024 → 16 Oct 2024

Publication series

NameUIST Adjunct 2024 - Proceedings of the 37th Annual ACM Symposium on User Interface Software and Technology

Conference

Conference37th Annual ACM Symposium on User Interface Software and Technology, UIST Adjunct 2024
Country/TerritoryUnited States
CityPittsburgh
Period13/10/24 → 16/10/24

Keywords

  • Gesture Recognition
  • Keyboard
  • Machine Learning
  • Passive Acoustic Sensing
  • Typing Experience

ASJC Scopus subject areas

  • Human-Computer Interaction
  • Software

Fingerprint

Dive into the research topics of 'KeyFlow: Acoustic Motion Sensing for Cursor Control on Any Keyboard'. Together they form a unique fingerprint.

Cite this