BWGAN-GP: An EEG Data Generation Method for Class Imbalance Problem in RSVP Tasks

• Published in: IEEE transactions on neural systems and rehabilitation engineering Vol. 30; pp. 251 - 263
• Main Authors: Xu, Meng, Chen, Yuanfang, Wang, Yijun, Wang, Dan, Liu, Zehua, Zhang, Lijian
• Format: Journal Article
• Language: English
• Published: United States IEEE 2022; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: auto-encoder; Brain modeling; Brain-Computer Interfaces; Calibration; class imbalance problem; Classification; Data augmentation; Deep learning; EEG; Electroencephalography; Generative adversarial networks; Human-computer interface; Humans; Interfaces; Learning; Machine learning; Mathematical models; Performance evaluation; Rapid serial visual presentation (RSVP); Task analysis; Training; Visual tasks; Visualization; Wasserstein generative adversarial network (WGAN)
• ISSN: 1534-4320; 1558-0210; 1558-0210
• DOI: 10.1109/TNSRE.2022.3145515

In the rapid serial visual presentation (RSVP) classification task, the data from the target and non-target classes are incredibly imbalanced. These class imbalance problems (CIPs) can hinder the classifier from achieving better performance, especially in deep learning. This paper proposed a novel data augmentation method called balanced Wasserstein generative adversarial network with gradient penalty (BWGAN-GP) to generate RSVP minority class data. The model learned useful features from majority classes and used them to generate minority-class artificial EEG data. It combines generative adversarial network (GAN) with autoencoder initialization strategy enables this method to learn an accurate class-conditioning in the latent space to drive the generation process towards the minority class. We used RSVP datasets from nine subjects to evaluate the classification performance of our proposed generated model and compare them with those of other methods. The average AUC obtained with BWGAN-GP on EEGNet was 94.43%, an increase of 3.7% over the original data. We also used different amounts of original data to investigate the effect of the generated EEG data on the calibration phase. Only 60% of original data were needed to achieve acceptable classification performance. These results show that the BWGAN-GP could effectively alleviate CIPs in the RSVP task and obtain the best performance when the two classes of data are balanced. The findings suggest that data augmentation techniques could generate artificial EEG to reduce calibration time in other brain-computer interfaces (BCI) paradigms similar to RSVP.