A Time Delay Neural Network model for simulating eye gaze data

Yun Zhang, Xiaoyu Zhao, Hong Fu, Zhen Liang, Zheru Chi, Xinbo Zhao, Dagan Feng

Research output: Journal article publicationJournal articleAcademic researchpeer-review

8 Citations (Scopus)

Abstract

Human eye movement modelling is a new, challenging and promising research topic in computer vision. Human eye movement modelling aims at simulating the scan path in which a human being views an image, a scene or a video. The successful modelling of human eye movements potentially benefits a wide range of applications such as image retrieval, image annotation, medical image diagnosis and human visual perception. This article presents a model based on a Time Delay Neural Network (TDNN) to simulate eye gaze data. First, 120 Hz eye gaze data are acquired by a non-intrusive table-mounted eye tracker. Our proposed model is to simulate the image reading process of a single subject. Seven features are then extracted based on the knowledge of the human oculomotor system and the image contents to train a TDNN. Finally, the trained TDNN combined with a saccade control mechanism is used to simulate the scan path of a human being viewing an image. The proposed model can generate 600 points of raw eye gaze data in a 5-second eye viewing window. Both subjective and objective methods are used to evaluate the model by comparing its behaviour and characteristics with the real eye gaze data collected from an eye tracker. Qualitative assessment shows that the subject can hardly tell the differences between the scan path from the model and that from a human being. By evaluating the coincident probability Cpand coincident significance Cs, quantitative assessment shows that the results from the TDNN model are reasonable and similar to human scan paths.
Original languageEnglish
Pages (from-to)111-126
Number of pages16
JournalJournal of Experimental and Theoretical Artificial Intelligence
Volume23
Issue number1
DOIs
Publication statusPublished - 1 Mar 2011

Keywords

  • Coincident probability
  • Coincident significance
  • Eye movement modelling
  • Oculomotor control
  • Time delayed neural networks
  • Visual attention model

ASJC Scopus subject areas

  • Software
  • Theoretical Computer Science
  • Artificial Intelligence

Cite this