Deep Learning Based Inter-subject Continuous Decoding of Motor Imagery for Practical Brain-Computer Interfaces

• Published in: Frontiers in neuroscience Vol. 14; p. 918
• Main Authors: Roy, Sujit, Chowdhury, Anirban, McCreadie, Karl, Prasad, Girijesh
• Format: Journal Article
• Language: English
• Published: Lausanne Frontiers Research Foundation 30.09.2020; Frontiers Media S.A
• Subjects: Adaptation; adaptive learning; Algorithms; Bayesian analysis; brain-computer interface (BCI); Calibration; Classification; Competition; convolutional neural network (CNN); Datasets; Deep learning; Discriminant analysis; EEG; electroencephalography (EEG); Feedback; Interfaces; Mental task performance; motor imagery; Neural networks; Neuroscience; Transfer learning
• ISSN: 1662-453X; 1662-4548; 1662-453X
• DOI: 10.3389/fnins.2020.00918

Inter-subject transfer learning is a long-standing problem in brain-computer interfaces (BCIs) and has not yet been fully realized due to high inter-subject variability in the brain signals related to motor imagery (MI). The recent success of deep learning-based algorithms in classifying different brain signals warrants further exploration to determine whether it is feasible for the inter-subject continuous decoding of MI signals to provide contingent neurofeedback which is important for neurorehabilitative BCI designs. In this paper, we have shown how a convolutional neural network (CNN) based deep learning framework can be used for inter-subject continuous decoding of MI related electroencephalographic (EEG) signals using the novel concept of Mega Blocks for adapting the network against inter-subject variabilities. These Mega Blocks have the capacity to repeat a specific architectural block several times such as one or more convolutional layers in a single Mega Block. The parameters of such Mega Blocks can be optimized using Bayesian hyperparameter optimization. The results, obtained on the publicly available BCI competition IV-2b dataset, yields an average inter-subject continuous decoding accuracy of 71.49% (kappa=0.42) and 70.84% (kappa =0.42) for two different training methods such as adaptive moment estimation (Adam) and stochastic gradient descent (SGDM) respectively in 7 out of 9 subjects. Our results show for the first time that it is feasible to use CNN based architectures for inter-subject continuous decoding with a sufficient level of accuracy for developing calibration-free MI-BCIs for practical purposes.