Detecting stress from mouse-gaze attraction

Jun Wang, Eugene Yujun Fu, Grace Ngai, Hong Va Leong, Michael Xuelin Huang

Research output: Chapter in book / Conference proceedingConference article published in proceeding or bookAcademic researchpeer-review

7 Citations (Scopus)


Mental stress can cause mental illnesses like anxiety and depression. It is often detected by experts, or via intrusive devices attached to human, both are not viable in daily life. Recent research demonstrated that non-intrusive stress detection is viable through the analysis of mouse and gaze dynamics as a user is using the computer. However, these works require prior knowledge of the user interface (UI) layout information to build up appropriate models. This greatly reduces their generalizability to real usage, where most tasks are carried out with dynamic UIs. This paper presents a UI-agnostic stress detection system, Moga, to infer user stress level in tasks without being concerned on the actual UI. Moga adopts an innovative mouse-gaze attraction model, which leverages the coordination between mouse and eye movement without considering the UI information. We evaluate the performance of Moga with tasks on dynamic and fixed UI. Our experimental results demonstrate the effectiveness of the underlying mouse-gaze attraction model, which can achieve stress detection accuracy of 74.3% for dynamic UI tasks, beating the state-of-the-art approach by around 15%. It opens up a new avenue for cognitive-aware intelligent user interface and numerous advanced HCI studies.

Original languageEnglish
Title of host publicationProceedings of the ACM Symposium on Applied Computing
PublisherAssociation for Computing Machinery
Number of pages9
ISBN (Print)9781450359337
Publication statusPublished - 1 Jan 2019
Event34th Annual ACM Symposium on Applied Computing, SAC 2019 - Limassol, Cyprus
Duration: 8 Apr 201912 Apr 2019

Publication series

NameProceedings of the ACM Symposium on Applied Computing
VolumePart F147772


Conference34th Annual ACM Symposium on Applied Computing, SAC 2019


  • Gaze-mouse correlation
  • Human-computer interaction
  • Stress detection

ASJC Scopus subject areas

  • Software


Dive into the research topics of 'Detecting stress from mouse-gaze attraction'. Together they form a unique fingerprint.

Cite this