Skip to main navigation Skip to search Skip to main content

Classification of motor imagery EEG using deep learning increases performance in inefficient BCI users

Research output: Contribution to JournalArticleAcademicpeer-review

Abstract

Motor Imagery Brain-Computer Interfaces (MI-BCIs) are AI-driven systems that capture brain activity patterns associated with mental imagination of movement and convert them into commands for external devices. Traditionally, MI-BCIs operate on Machine Learning (ML) algorithms, which require extensive signal processing and feature engineering to extract changes in sensorimotor rhythms (SMR). In recent years, Deep Learning (DL) models have gained popularity for EEG classification as they provide a solution for automatic extraction of spatio-temporal features in the signals. However, past BCI studies that employed DL models, only attempted them with a small group of participants, without investigating the effectiveness of this approach for different user groups such as inefficient users. BCI inefficiency is a known and unsolved problem within BCI literature, generally defined as the inability of the user to produce the desired SMR patterns for the BCI classifier. In this study, we evaluated the effectiveness of DL models in capturing MI features particularly in the inefficient users. EEG signals from 54 subjects who performed a MI task of left- or right-hand grasp were recorded to compare the performance of two classification approaches; a ML approach vs. a DL approach. In the ML approach, Common Spatial Patterns (CSP) was used for feature extraction and then Linear Discriminant Analysis (LDA) model was employed for binary classification of the MI task. In the DL approach, a Convolutional Neural Network (CNN) model was constructed on the raw EEG signals. Additionally, subjects were divided into high vs. low performers based on their online BCI accuracy and the difference between the two classifiers’ performance was compared between groups. Our results showed that the CNN model improved the classification accuracy for all subjects within the range of 2.37 to 28.28%, but more importantly, this improvement was significantly larger for low performers. Our findings show promise for employment of DL models on raw EEG signals in future MI-BCI systems, particularly for BCI inefficient users who are unable to produce desired sensorimotor patterns for conventional ML approaches.
Original languageEnglish
Article numbere0268880
JournalPLoS ONE
Volume17
Issue number7 July
DOIs
Publication statusPublished - 1 Jul 2022
Externally publishedYes

Funding

This research was made possible in part through funding from the municipality of Tilburg, Netherlands, on the MindLabs initiative. Unravel research provided support in the form of salary for the second author (NL), but did not have any additional role in the study design, data collection and analysis, decision to publish, or preparation of the manuscript. (It is worth noting that the second author designed the study and collected the data while she was still a Master’s student at Tilburg university. She shared her data with the first author and collaborated on this study once she graduated from our department and started working at Unravel Research. This means that the commercial affiliation did not have any role in the study design, data collection or analysis. Recently the second author started a PhD program at Tilburg University and hence her main affiliation is Tilburg University.)

Funders
Universiteit van Tilburg

    Fingerprint

    Dive into the research topics of 'Classification of motor imagery EEG using deep learning increases performance in inefficient BCI users'. Together they form a unique fingerprint.

    Cite this