Towards imagined speech: Identification of brain states from EEG signals for BCI-based communication systems

• Published in: Behavioural brain research Vol. 477; p. 115295
• Main Authors: V., Haresh M., Begum, B. Shameedha
• Format: Journal Article
• Language: English
• Published: Netherlands Elsevier B.V 04.02.2025
• Subjects: Adult; Brain - physiology; Brain-computer interface; Brain-Computer Interfaces; Electroencephalogram; Electroencephalography - methods; Female; Humans; Imagination - physiology; Imagined speech; Machine Learning; Male; Neural Networks, Computer; Speech - physiology; Speech recognition; Young Adult; Brain-computer interface; Imagined speech; Electroencephalogram; Machine learning; Speech recognition
• ISSN: 0166-4328; 1872-7549; 1872-7549
• DOI: 10.1016/j.bbr.2024.115295

The electroencephalogram (EEG) based brain-computer interface (BCI) system employing imagined speech serves as a mechanism for decoding EEG signals to facilitate control over external devices or communication with the external world at the moment the user desires. To effectively deploy such BCIs, it is imperative to accurately discern various brain states from continuous EEG signals when users initiate word imagination. This study involved the acquisition of EEG signals from 15 subjects engaged in four states: resting, listening, imagined speech, and actual speech, each involving a predefined set of 10 words. The EEG signals underwent preprocessing, segmentation, spatio-temporal and spectral analysis of each state, and functional connectivity analysis using the phase locking value (PLV) method. Subsequently, five features were extracted from the frequency and time-frequency domains. Classification tasks were performed using four machine learning algorithms in both pair-wise and multiclass scenarios, considering subject-dependent and subject-independent data. In the subject-dependent scenario, the random forest (RF) classifier achieved a maximum accuracy of 94.60 % for pairwise classification, while the artificial neural network (ANN) classifier achieved a maximum accuracy of 66.92 % for multiclass classification. In the subject-independent scenario, the random forest (RF) classifier achieved maximum accuracies of 81.02 % for pairwise classification and 55.58 % for multiclass classification. Moreover, EEG signals were classified based on frequency bands and brain lobes, revealing that the theta (θ) and delta (δ) bands, as well as the frontal and temporal lobes, are sufficient for distinguishing between brain states. The findings promise to develop a system capable of automatically segmenting imagined speech segments from continuous EEG signals. •Explored four brain states: rest, listening, imagined speech, and actual speech.•Identified key differences in brain activity across different brain states using spatio-temporal, spectral, and functional analyses.•Achieved reasonable accuracy for classifying brain states with both subject-dependent and subject-independent models.•Identified the significance of θ and δ bands and the role of the frontal and temporal lobes in distinguishing brain states.