Enhanced performance by a hybrid NIRS-EEG brain computer interface

Siamac Fazli, Jan Mehnert, Jens Steinbrink, Gabriel Curio, Arno Villringer, Klaus Robert Müller, Benjamin Blankertz

Research output: Contribution to journalArticle

281 Citations (Scopus)

Abstract

Noninvasive Brain Computer Interfaces (BCI) have been promoted to be used for neuroprosthetics. However, reports on applications with electroencephalography (EEG) show a demand for a better accuracy and stability. Here we investigate whether near-infrared spectroscopy (NIRS) can be used to enhance the EEG approach. In our study both methods were applied simultaneously in a real-time Sensory Motor Rhythm (SMR)-based BCI paradigm, involving executed movements as well as motor imagery. We tested how the classification of NIRS data can complement ongoing real-time EEG classification. Our results show that simultaneous measurements of NIRS and EEG can significantly improve the classification accuracy of motor imagery in over 90% of considered subjects and increases performance by 5% on average (p < 0:01). However, the long time delay of the hemodynamic response may hinder an overall increase of bit-rates. Furthermore we find that EEG and NIRS complement each other in terms of information content and are thus a viable multimodal imaging technique, suitable for BCI.

Original languageEnglish
Pages (from-to)519-529
Number of pages11
JournalNeuroImage
Volume59
Issue number1
DOIs
Publication statusPublished - Jan 2 2012
Externally publishedYes

Fingerprint

Brain-Computer Interfaces
Near-Infrared Spectroscopy
Electroencephalography
Imagery (Psychotherapy)
Multimodal Imaging
Hemodynamics

Keywords

  • Combined NIRS-EEG
  • Hybrid BCI
  • Meta-classifier

ASJC Scopus subject areas

  • Neurology
  • Cognitive Neuroscience

Cite this

Fazli, S., Mehnert, J., Steinbrink, J., Curio, G., Villringer, A., Müller, K. R., & Blankertz, B. (2012). Enhanced performance by a hybrid NIRS-EEG brain computer interface. NeuroImage, 59(1), 519-529. https://doi.org/10.1016/j.neuroimage.2011.07.084

Enhanced performance by a hybrid NIRS-EEG brain computer interface. / Fazli, Siamac; Mehnert, Jan; Steinbrink, Jens; Curio, Gabriel; Villringer, Arno; Müller, Klaus Robert; Blankertz, Benjamin.

In: NeuroImage, Vol. 59, No. 1, 02.01.2012, p. 519-529.

Research output: Contribution to journalArticle

Fazli, S, Mehnert, J, Steinbrink, J, Curio, G, Villringer, A, Müller, KR & Blankertz, B 2012, 'Enhanced performance by a hybrid NIRS-EEG brain computer interface', NeuroImage, vol. 59, no. 1, pp. 519-529. https://doi.org/10.1016/j.neuroimage.2011.07.084
Fazli S, Mehnert J, Steinbrink J, Curio G, Villringer A, Müller KR et al. Enhanced performance by a hybrid NIRS-EEG brain computer interface. NeuroImage. 2012 Jan 2;59(1):519-529. https://doi.org/10.1016/j.neuroimage.2011.07.084
Fazli, Siamac ; Mehnert, Jan ; Steinbrink, Jens ; Curio, Gabriel ; Villringer, Arno ; Müller, Klaus Robert ; Blankertz, Benjamin. / Enhanced performance by a hybrid NIRS-EEG brain computer interface. In: NeuroImage. 2012 ; Vol. 59, No. 1. pp. 519-529.
@article{84d910bfe11d4ffc8c72cf0fc68455d2,
title = "Enhanced performance by a hybrid NIRS-EEG brain computer interface",
abstract = "Noninvasive Brain Computer Interfaces (BCI) have been promoted to be used for neuroprosthetics. However, reports on applications with electroencephalography (EEG) show a demand for a better accuracy and stability. Here we investigate whether near-infrared spectroscopy (NIRS) can be used to enhance the EEG approach. In our study both methods were applied simultaneously in a real-time Sensory Motor Rhythm (SMR)-based BCI paradigm, involving executed movements as well as motor imagery. We tested how the classification of NIRS data can complement ongoing real-time EEG classification. Our results show that simultaneous measurements of NIRS and EEG can significantly improve the classification accuracy of motor imagery in over 90{\%} of considered subjects and increases performance by 5{\%} on average (p < 0:01). However, the long time delay of the hemodynamic response may hinder an overall increase of bit-rates. Furthermore we find that EEG and NIRS complement each other in terms of information content and are thus a viable multimodal imaging technique, suitable for BCI.",
keywords = "Combined NIRS-EEG, Hybrid BCI, Meta-classifier",
author = "Siamac Fazli and Jan Mehnert and Jens Steinbrink and Gabriel Curio and Arno Villringer and M{\"u}ller, {Klaus Robert} and Benjamin Blankertz",
year = "2012",
month = "1",
day = "2",
doi = "10.1016/j.neuroimage.2011.07.084",
language = "English",
volume = "59",
pages = "519--529",
journal = "NeuroImage",
issn = "1053-8119",
publisher = "Academic Press Inc.",
number = "1",

}

TY - JOUR

T1 - Enhanced performance by a hybrid NIRS-EEG brain computer interface

AU - Fazli, Siamac

AU - Mehnert, Jan

AU - Steinbrink, Jens

AU - Curio, Gabriel

AU - Villringer, Arno

AU - Müller, Klaus Robert

AU - Blankertz, Benjamin

PY - 2012/1/2

Y1 - 2012/1/2

N2 - Noninvasive Brain Computer Interfaces (BCI) have been promoted to be used for neuroprosthetics. However, reports on applications with electroencephalography (EEG) show a demand for a better accuracy and stability. Here we investigate whether near-infrared spectroscopy (NIRS) can be used to enhance the EEG approach. In our study both methods were applied simultaneously in a real-time Sensory Motor Rhythm (SMR)-based BCI paradigm, involving executed movements as well as motor imagery. We tested how the classification of NIRS data can complement ongoing real-time EEG classification. Our results show that simultaneous measurements of NIRS and EEG can significantly improve the classification accuracy of motor imagery in over 90% of considered subjects and increases performance by 5% on average (p < 0:01). However, the long time delay of the hemodynamic response may hinder an overall increase of bit-rates. Furthermore we find that EEG and NIRS complement each other in terms of information content and are thus a viable multimodal imaging technique, suitable for BCI.

AB - Noninvasive Brain Computer Interfaces (BCI) have been promoted to be used for neuroprosthetics. However, reports on applications with electroencephalography (EEG) show a demand for a better accuracy and stability. Here we investigate whether near-infrared spectroscopy (NIRS) can be used to enhance the EEG approach. In our study both methods were applied simultaneously in a real-time Sensory Motor Rhythm (SMR)-based BCI paradigm, involving executed movements as well as motor imagery. We tested how the classification of NIRS data can complement ongoing real-time EEG classification. Our results show that simultaneous measurements of NIRS and EEG can significantly improve the classification accuracy of motor imagery in over 90% of considered subjects and increases performance by 5% on average (p < 0:01). However, the long time delay of the hemodynamic response may hinder an overall increase of bit-rates. Furthermore we find that EEG and NIRS complement each other in terms of information content and are thus a viable multimodal imaging technique, suitable for BCI.

KW - Combined NIRS-EEG

KW - Hybrid BCI

KW - Meta-classifier

UR - http://www.scopus.com/inward/record.url?scp=80054090365&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=80054090365&partnerID=8YFLogxK

U2 - 10.1016/j.neuroimage.2011.07.084

DO - 10.1016/j.neuroimage.2011.07.084

M3 - Article

VL - 59

SP - 519

EP - 529

JO - NeuroImage

JF - NeuroImage

SN - 1053-8119

IS - 1

ER -