Multiclass Classification of Word Imagination Speech With Hybrid Connectivity Features

• Published in: IEEE transactions on biomedical engineering Vol. 65; no. 10; pp. 2168 - 2177
• Main Authors: Qureshi, Muhammad Naveed Iqbal, Min, Beomjun, Park, Hyeong-Jun, Cho, Dongrae, Choi, Woosu, Lee, Boreom
• Format: Journal Article
• Language: English
• Published: United States IEEE 01.10.2018; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Adult; Algorithms; Brain; Broca Area - physiology; Broca's and Wernicke's area; Classification; Connectivity; Correlation analysis; Covariance; Covariance matrices; Data mining; EEG; Electroencephalography; Electroencephalography - methods; Feature extraction; Female; Humans; Image Processing, Computer-Assisted; Image reconstruction; Imagination; Imagination - classification; Imagination - physiology; Learning algorithms; Male; Mathematical analysis; Matrix methods; Mental task performance; multiclass classification; Neural networks; phase-only feature extraction; Recording; Signal Processing, Computer-Assisted; Speech; Speech - physiology; Speech perception; Time series analysis; Wernicke Area - physiology; Word imagination; Young Adult
• ISSN: 0018-9294; 1558-2531; 1558-2531
• DOI: 10.1109/TBME.2017.2786251

Objective: In this study, electroencephalography data of imagined words were classified using four different feature extraction approaches. Eight subjects were recruited for the recording of imagination with five different words, namely; "go," "back," "left," "right," and "stop." Methods: One hundred trials for each word were recorded for both imagination and perception, although this study utilized only imagination data. Two different connectivity methods were applied, namely; a covariance-based and a maximum linear cross-correlation-based connectivity measure. These connectivity measures were further computed to extract the phase-only data as an additional method of feature extraction. In addition, four different channel selections were used. The final connectivity matrix from each of the four methods was vectorized and used as the feature vector for the classifier. To classify EEG data, a sigmoid activation function-based linear extreme learning machine was used. Result and Significance: We achieved a maximum classification rate of 40.30% (p <; 0.007) and 87.90% (p <; 0.003) in multiclass (five classes) and binary settings, respectively. Thus, our results suggested that EEG responses to imagined speech could be successfully classified using an extreme learning machine. Conclusion: This study involving the classification of imagined words can be a milestone contribution toward the development of practical brain-computer interface systems using silent speech.