TMLP+SRDANN: A domain adaptation method for EEG-based emotion recognition

• Published in: Measurement : journal of the International Measurement Confederation Vol. 207; p. 112379
• Main Authors: Li, Wei, Hou, Bowen, Li, Xiaoyu, Qiu, Ziming, Peng, Bo, Tian, Ye
• Format: Journal Article
• Language: English
• Published: Elsevier Ltd 15.02.2023
• Subjects: Domain adaptation; Electroencephalogram; Emotion recognition; Sample-Reweighted Domain Adaptation Neural Network; Transposition Multi-Layer Perceptron; Domain adaptation; Emotion recognition; Electroencephalogram; Transposition Multi-Layer Perceptron; Sample-Reweighted Domain Adaptation Neural Network
• ISSN: 0263-2241; 1873-412X
• DOI: 10.1016/j.measurement.2022.112379

Electroencephalogram (EEG) contains emotion information, but usually undergoes severe signal variations. In the literature, for the issue of EEG-based emotion recognition, not only have diverse features been designed to capture the representative characteristics of EEG, but also various domain adaptation techniques have been devised to reduce the distributional discrepancy between the source and target domains. However, existing domain adaptation techniques for this issue treat all the source samples equally, but ignore their transferability difference, which more or less limits the performance of learned domain-invariant and class-discriminative EEG features for emotion recognition. To cope with this problem, we propose Transposition Multi-Layer Perceptron (TMLP) and Sample-Reweighted Domain Adaptation Neural Network (SRDANN) in one whole learning framework. TMLP extracts the robust multi-channel EEG features related to emotions; SRDANN transfers the discriminative knowledge from the source domain to the target domain for classifying emotions. By concentrating on the source samples with stronger transferability in domain adaptation, TMLP+SRDANN can learn the more domain-invariant and class-discriminative features from EEG, thus providing a more effective solution to emotion recognition in the challenging cross-subject scenario. The subject-independent emotion recognition experiments on two benchmark datasets have demonstrated the effectiveness of our method: an accuracy of 81.04% for emotion classification on SEED, 61.88% for valence classification and 57.70% for arousal classification on DEAP. •We design TMLP to extract the discriminative EEG features for emotion recognition.•We devise SRDANN for cross-subject domain adaptation in emotion classification.•SRDANN uses a domain classifier with GRL to narrow the data distribution discrepancy.•SRDANN uses a domain classifier with GVL to calculate the source data transferability.•We demonstrate the effectiveness of TMLP+SRDANN on the benchmarks SEED and DEAP.