Improving Chinese Reading Comprehensions of Dyslexic Children via VR Reading: A Step Towards Tackling Dyslexia with Top-Down Teaching

Billy C.Y. Fu, Zackary P.T. Sin, Peter H.F. Ng, Alice Cheng-Lai

Research output: Chapter in book / Conference proceedingConference article published in proceeding or bookAcademic researchpeer-review

1 Citation (Scopus)

Abstract

Dyslexia cause neurological limitations upon its patients such that they have poor phonological awareness and orthographical skills. This in turn limit the patients’ abilities to derive meaning from words which are keys to effective reading. To aid dyslexics in their comprehensions, a top-down approach to reading is proposed. In the meanwhile, a graphical model is also proposed as a tool to help researchers pinpoint neurological processes. It cleanly shows that the top-down approach could bypass dyslexic patients’ neurological limitations. It is also hypothesized that by aiding their understanding of articles and words, it is also possible for patients to improve their phonological awareness and orthographical skills. Our implementation to the research goals is VR reading, which uses multimedia feedback to give cues to dyslexic students on the meaning of words and articles. VR reading consists of aiding images, voice-overs, videos and a background theme dome that gives encapsulated cues on the meanings of the article and its words that are detached from the article itself. This is an important design decision as we want dyslexic students to rely more on multimedia feedback in deriving the meaning. We also show a preliminary evaluation which is a step towards testifying the aforementioned hypotheses with VR reading. It involves primary school children to read a Chinese article and be evaluated afterwards. The result seems to indicate that VR reading is useful in aiding students in their reading comprehension and additionally, has potential to improve their phonological awareness and orthographical skills.

Original languageEnglish
Title of host publicationAdvances in Visual Computing - 15th International Symposium, ISVC 2020, Proceedings
EditorsGeorge Bebis, Zhaozheng Yin, Edward Kim, Jan Bender, Kartic Subr, Bum Chul Kwon, Jian Zhao, Denis Kalkofen, George Baciu
PublisherSpringer Science and Business Media Deutschland GmbH
Pages630-641
Number of pages12
ISBN (Print)9783030645557
DOIs
Publication statusPublished - 2020
Event15th International Symposium on Visual Computing, ISVC 2020 - San Diego, United States
Duration: 5 Oct 20207 Oct 2020

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume12509 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference15th International Symposium on Visual Computing, ISVC 2020
Country/TerritoryUnited States
CitySan Diego
Period5/10/207/10/20

Keywords

  • Chinese language
  • Dyslexia
  • Neurological processes as graphical models
  • Reading comprehension
  • Top-down teaching
  • VR educational application

ASJC Scopus subject areas

  • Theoretical Computer Science
  • General Computer Science

Fingerprint

Dive into the research topics of 'Improving Chinese Reading Comprehensions of Dyslexic Children via VR Reading: A Step Towards Tackling Dyslexia with Top-Down Teaching'. Together they form a unique fingerprint.

Cite this