Evaluation of Motor Training Performance in 3D Virtual Environment via Combining Brain-computer Interface and Haptic Feedback

Hong Wu; Shuang Liang; Wenlong Hang; Xiaolu Liu; Qiong Wang; Kup Sze Choi; Jing Qin

doi:10.1016/j.procs.2017.03.096

Evaluation of Motor Training Performance in 3D Virtual Environment via Combining Brain-computer Interface and Haptic Feedback

Hong Wu, Shuang Liang, Wenlong Hang, Xiaolu Liu, Qiong Wang, Kup Sze Choi, Jing Qin

Research output: Journal article publication › Conference article › Academic research › peer-review

11 Citations (Scopus)

Abstract

Brain-computer interfaces (BCIs) based on virtual reality (VR) mostly integrate visual and/or auditory feedback. Haptic feedbackwhich has the potential on improving the feasibility and operability of VR-based BCI systems is rarely explored in previous studies. In this article, we present a novel framework of BCI system based on both visual and haptic feedback, in which users can learn to manipulate the haptic device's stylus for motor training. The effects of motor training with and without haptic feedback are evaluated by detecting and analysing the changes of electroencephalogram (EEG). The preliminary experimental results indicate that haptic feedback may influence the modulation of the beta rhythms over left and right sensorimotor cortex during hand movements. This study can be easily replicated to evaluate the existing systems with haptic feedback and used to develop new applications for motor training.

Original language	English
Pages (from-to)	256-261
Number of pages	6
Journal	Procedia Computer Science
Volume	107
DOIs	https://doi.org/10.1016/j.procs.2017.03.096
Publication status	Published - 1 Jan 2017
Event	7th International Congress of Information and Communication Technology, ICICT 2017 - Sanya, China Duration: 1 Jan 2017 → 2 Feb 2017

Keywords

brain-computer interface (BCI)
Electroencephalogram (EEG)
event-related spectral perturbation (ERSP)
Haptic feedback
virtual reality (VR)

ASJC Scopus subject areas

Computer Science(all)

More information

10.1016/j.procs.2017.03.096

Cite this

@article{48caa1434bb843b68e8c609fcd32e79d,

title = "Evaluation of Motor Training Performance in 3D Virtual Environment via Combining Brain-computer Interface and Haptic Feedback",

abstract = "Brain-computer interfaces (BCIs) based on virtual reality (VR) mostly integrate visual and/or auditory feedback. Haptic feedbackwhich has the potential on improving the feasibility and operability of VR-based BCI systems is rarely explored in previous studies. In this article, we present a novel framework of BCI system based on both visual and haptic feedback, in which users can learn to manipulate the haptic device's stylus for motor training. The effects of motor training with and without haptic feedback are evaluated by detecting and analysing the changes of electroencephalogram (EEG). The preliminary experimental results indicate that haptic feedback may influence the modulation of the beta rhythms over left and right sensorimotor cortex during hand movements. This study can be easily replicated to evaluate the existing systems with haptic feedback and used to develop new applications for motor training.",

keywords = "brain-computer interface (BCI), Electroencephalogram (EEG), event-related spectral perturbation (ERSP), Haptic feedback, virtual reality (VR)",

author = "Hong Wu and Shuang Liang and Wenlong Hang and Xiaolu Liu and Qiong Wang and Choi, {Kup Sze} and Jing Qin",

year = "2017",

month = jan,

day = "1",

doi = "10.1016/j.procs.2017.03.096",

language = "English",

volume = "107",

pages = "256--261",

journal = "Procedia Computer Science",

issn = "1877-0509",

publisher = "Elsevier BV",

note = "7th International Congress of Information and Communication Technology, ICICT 2017 ; Conference date: 01-01-2017 Through 02-02-2017",

}

TY - JOUR

T1 - Evaluation of Motor Training Performance in 3D Virtual Environment via Combining Brain-computer Interface and Haptic Feedback

AU - Wu, Hong

AU - Liang, Shuang

AU - Hang, Wenlong

AU - Liu, Xiaolu

AU - Wang, Qiong

AU - Choi, Kup Sze

AU - Qin, Jing

PY - 2017/1/1

Y1 - 2017/1/1

N2 - Brain-computer interfaces (BCIs) based on virtual reality (VR) mostly integrate visual and/or auditory feedback. Haptic feedbackwhich has the potential on improving the feasibility and operability of VR-based BCI systems is rarely explored in previous studies. In this article, we present a novel framework of BCI system based on both visual and haptic feedback, in which users can learn to manipulate the haptic device's stylus for motor training. The effects of motor training with and without haptic feedback are evaluated by detecting and analysing the changes of electroencephalogram (EEG). The preliminary experimental results indicate that haptic feedback may influence the modulation of the beta rhythms over left and right sensorimotor cortex during hand movements. This study can be easily replicated to evaluate the existing systems with haptic feedback and used to develop new applications for motor training.

AB - Brain-computer interfaces (BCIs) based on virtual reality (VR) mostly integrate visual and/or auditory feedback. Haptic feedbackwhich has the potential on improving the feasibility and operability of VR-based BCI systems is rarely explored in previous studies. In this article, we present a novel framework of BCI system based on both visual and haptic feedback, in which users can learn to manipulate the haptic device's stylus for motor training. The effects of motor training with and without haptic feedback are evaluated by detecting and analysing the changes of electroencephalogram (EEG). The preliminary experimental results indicate that haptic feedback may influence the modulation of the beta rhythms over left and right sensorimotor cortex during hand movements. This study can be easily replicated to evaluate the existing systems with haptic feedback and used to develop new applications for motor training.

KW - brain-computer interface (BCI)

KW - Electroencephalogram (EEG)

KW - event-related spectral perturbation (ERSP)

KW - Haptic feedback

KW - virtual reality (VR)

UR - http://www.scopus.com/inward/record.url?scp=85029177199&partnerID=8YFLogxK

U2 - 10.1016/j.procs.2017.03.096

DO - 10.1016/j.procs.2017.03.096

M3 - Conference article

SN - 1877-0509

VL - 107

SP - 256

EP - 261

JO - Procedia Computer Science

JF - Procedia Computer Science

T2 - 7th International Congress of Information and Communication Technology, ICICT 2017

Y2 - 1 January 2017 through 2 February 2017

ER -

Evaluation of Motor Training Performance in 3D Virtual Environment via Combining Brain-computer Interface and Haptic Feedback

Abstract

Keywords

ASJC Scopus subject areas

More information

Other files and links

Fingerprint

Cite this