Research on EEG emotion recognition based on CNN+BiLSTM+self-attention model

• Published in: Optoelectronics letters Vol. 19; no. 8; pp. 506 - 512
• Main Authors: Li, Xueqing, Li, Penghai, Fang, Zhendong, Cheng, Longlong, Wang, Zhiyong, Wang, Weijie
• Format: Journal Article
• Language: English
• Published: Berlin/Heidelberg Springer Berlin Heidelberg 01.08.2023; Springer Nature B.V
• Subjects: Artificial neural networks; Channels; Electroencephalography; Emotion recognition; Emotions; Feature extraction; Lasers; Neural networks; Optical Devices; Optics; Photonics; Physics; Physics and Astronomy; A
• ISSN: 1673-1905; 1993-5013
• DOI: 10.1007/s11801-023-2207-x

To address the problems of insufficient dimensionality of electroencephalogram (EEG) feature extraction, the tendency to ignore the importance of different sequential data segments, and the poor generalization ability of the model in EEG based emotion recognition, the model of convolutional neural network and bi-directional long short-term memory and self-attention (CNN+BiLSTM+self-attention) is proposed. This model uses convolutional neural network (CNN) to extract more distinctive features from both spatial and temporal dimensions. The bi-directional long short-term memory (BiLSTM) is used to further preserve the long-term dependencies between the temporal phases of sequential data. The self-attention mechanism can change the weights of different channels to extract and highlight important information and address the often-ignored importance of different channels and samples when extracting EEG features. The subject-dependent experiment and subject-independent experiment are performed on the database for emotion analysis using physiological signals (DEAP) and collected datasets to verify the recognition performance. The experimental results show that the model proposed in this paper has excellent recognition performance and generalization ability.