Predicting what you remember from brain activity: EEG-based decoding of long-term memory formation

Taeho Kang, Yiyu Chen, Siamac Fazli, Christian Wallraven

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

The use of EEG to enhance learning experience in learning environments can contribute to furthering symbiotic relationship between the user and the system. This study examines whether it is possible to predict successful memorization of previously-learned words in a language learning context from brain activity alone. Participants are tasked with learning German-Korean word association pairs, and their retention performance is tested on the day of and the after learning. We perform statistical analysis as well as single-trial classification to investigate whether brain activity as recorded via multi-channel EEG is able to predict whether a word is remembered or not. Our preliminary results confirm above-chance prediction of successful word learning.

Original languageEnglish
Title of host publicationSymbiotic Interaction - 6th International Workshop, Symbiotic 2017, Revised Selected Papers
EditorsBenjamin Blankertz, Anna Spagnolli, Luciano Gamberini, Giulio Jacucci, Jaap Ham
PublisherSpringer Verlag
Pages63-73
Number of pages11
ISBN (Print)9783319915920
DOIs
Publication statusPublished - Jan 1 2018
Externally publishedYes
Event6th International Workshop on Symbiotic Interaction, SYMBIOTIC 2017 - Eindhoven, Netherlands
Duration: Dec 18 2017Dec 19 2017

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume10727 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference6th International Workshop on Symbiotic Interaction, SYMBIOTIC 2017
CountryNetherlands
CityEindhoven
Period12/18/1712/19/17

Fingerprint

Memory Term
Electroencephalography
Decoding
Brain
Data storage equipment
Statistical methods
Predict
Learning Environment
Statistical Analysis
Electroencephalogram
Learning
Prediction

Keywords

  • BCI
  • Education
  • EEG
  • Language learning
  • Memory

ASJC Scopus subject areas

  • Theoretical Computer Science
  • Computer Science(all)

Cite this

Kang, T., Chen, Y., Fazli, S., & Wallraven, C. (2018). Predicting what you remember from brain activity: EEG-based decoding of long-term memory formation. In B. Blankertz, A. Spagnolli, L. Gamberini, G. Jacucci, & J. Ham (Eds.), Symbiotic Interaction - 6th International Workshop, Symbiotic 2017, Revised Selected Papers (pp. 63-73). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 10727 LNCS). Springer Verlag. https://doi.org/10.1007/978-3-319-91593-7_7

Predicting what you remember from brain activity : EEG-based decoding of long-term memory formation. / Kang, Taeho; Chen, Yiyu; Fazli, Siamac; Wallraven, Christian.

Symbiotic Interaction - 6th International Workshop, Symbiotic 2017, Revised Selected Papers. ed. / Benjamin Blankertz; Anna Spagnolli; Luciano Gamberini; Giulio Jacucci; Jaap Ham. Springer Verlag, 2018. p. 63-73 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 10727 LNCS).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Kang, T, Chen, Y, Fazli, S & Wallraven, C 2018, Predicting what you remember from brain activity: EEG-based decoding of long-term memory formation. in B Blankertz, A Spagnolli, L Gamberini, G Jacucci & J Ham (eds), Symbiotic Interaction - 6th International Workshop, Symbiotic 2017, Revised Selected Papers. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 10727 LNCS, Springer Verlag, pp. 63-73, 6th International Workshop on Symbiotic Interaction, SYMBIOTIC 2017, Eindhoven, Netherlands, 12/18/17. https://doi.org/10.1007/978-3-319-91593-7_7
Kang T, Chen Y, Fazli S, Wallraven C. Predicting what you remember from brain activity: EEG-based decoding of long-term memory formation. In Blankertz B, Spagnolli A, Gamberini L, Jacucci G, Ham J, editors, Symbiotic Interaction - 6th International Workshop, Symbiotic 2017, Revised Selected Papers. Springer Verlag. 2018. p. 63-73. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). https://doi.org/10.1007/978-3-319-91593-7_7
Kang, Taeho ; Chen, Yiyu ; Fazli, Siamac ; Wallraven, Christian. / Predicting what you remember from brain activity : EEG-based decoding of long-term memory formation. Symbiotic Interaction - 6th International Workshop, Symbiotic 2017, Revised Selected Papers. editor / Benjamin Blankertz ; Anna Spagnolli ; Luciano Gamberini ; Giulio Jacucci ; Jaap Ham. Springer Verlag, 2018. pp. 63-73 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).
@inproceedings{44327e4eac2c464d9b205ebb78a4c07d,
title = "Predicting what you remember from brain activity: EEG-based decoding of long-term memory formation",
abstract = "The use of EEG to enhance learning experience in learning environments can contribute to furthering symbiotic relationship between the user and the system. This study examines whether it is possible to predict successful memorization of previously-learned words in a language learning context from brain activity alone. Participants are tasked with learning German-Korean word association pairs, and their retention performance is tested on the day of and the after learning. We perform statistical analysis as well as single-trial classification to investigate whether brain activity as recorded via multi-channel EEG is able to predict whether a word is remembered or not. Our preliminary results confirm above-chance prediction of successful word learning.",
keywords = "BCI, Education, EEG, Language learning, Memory",
author = "Taeho Kang and Yiyu Chen and Siamac Fazli and Christian Wallraven",
year = "2018",
month = "1",
day = "1",
doi = "10.1007/978-3-319-91593-7_7",
language = "English",
isbn = "9783319915920",
series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",
publisher = "Springer Verlag",
pages = "63--73",
editor = "Benjamin Blankertz and Anna Spagnolli and Luciano Gamberini and Giulio Jacucci and Jaap Ham",
booktitle = "Symbiotic Interaction - 6th International Workshop, Symbiotic 2017, Revised Selected Papers",
address = "Germany",

}

TY - GEN

T1 - Predicting what you remember from brain activity

T2 - EEG-based decoding of long-term memory formation

AU - Kang, Taeho

AU - Chen, Yiyu

AU - Fazli, Siamac

AU - Wallraven, Christian

PY - 2018/1/1

Y1 - 2018/1/1

N2 - The use of EEG to enhance learning experience in learning environments can contribute to furthering symbiotic relationship between the user and the system. This study examines whether it is possible to predict successful memorization of previously-learned words in a language learning context from brain activity alone. Participants are tasked with learning German-Korean word association pairs, and their retention performance is tested on the day of and the after learning. We perform statistical analysis as well as single-trial classification to investigate whether brain activity as recorded via multi-channel EEG is able to predict whether a word is remembered or not. Our preliminary results confirm above-chance prediction of successful word learning.

AB - The use of EEG to enhance learning experience in learning environments can contribute to furthering symbiotic relationship between the user and the system. This study examines whether it is possible to predict successful memorization of previously-learned words in a language learning context from brain activity alone. Participants are tasked with learning German-Korean word association pairs, and their retention performance is tested on the day of and the after learning. We perform statistical analysis as well as single-trial classification to investigate whether brain activity as recorded via multi-channel EEG is able to predict whether a word is remembered or not. Our preliminary results confirm above-chance prediction of successful word learning.

KW - BCI

KW - Education

KW - EEG

KW - Language learning

KW - Memory

UR - http://www.scopus.com/inward/record.url?scp=85051675154&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85051675154&partnerID=8YFLogxK

U2 - 10.1007/978-3-319-91593-7_7

DO - 10.1007/978-3-319-91593-7_7

M3 - Conference contribution

AN - SCOPUS:85051675154

SN - 9783319915920

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 63

EP - 73

BT - Symbiotic Interaction - 6th International Workshop, Symbiotic 2017, Revised Selected Papers

A2 - Blankertz, Benjamin

A2 - Spagnolli, Anna

A2 - Gamberini, Luciano

A2 - Jacucci, Giulio

A2 - Ham, Jaap

PB - Springer Verlag

ER -