Hierarchical feature fusion framework for frequency recognition in SSVEP-based BCIs

• Published in: Neural networks Vol. 119; pp. 1 - 9
• Main Authors: Zhang, Yangsong, Yin, Erwei, Li, Fali, Zhang, Yu, Guo, Daqing, Yao, Dezhong, Xu, Peng
• Format: Journal Article
• Language: English
• Published: United States Elsevier Ltd 01.11.2019
• Subjects: Adult; Algorithms; Brain-computer interface(BCI); Brain-Computer Interfaces; Correlated component analysis (CORRCA); Electroencephalogram (EEG); Electroencephalography - methods; Evoked Potentials, Visual - physiology; Feature fusion; Female; Humans; Male; Photic Stimulation - methods; Random Allocation; Recognition, Psychology - physiology; Steady-state visual evoked potential (SSVEP); Young Adult; Steady-state visual evoked potential (SSVEP); Feature fusion; Brain-computer interface(BCI); Electroencephalogram (EEG); Correlated component analysis (CORRCA)
• ISSN: 0893-6080; 1879-2782; 1879-2782
• DOI: 10.1016/j.neunet.2019.07.007

Effective frequency recognition algorithms are critical in steady-state visual evoked potential (SSVEP) based brain–computer interfaces (BCIs). In this study, we present a hierarchical feature fusion framework which can be used to design high-performance frequency recognition methods. The proposed framework includes two primary techniques for fusing features: spatial dimension fusion (SD) and frequency dimension fusion (FD). Both SD and FD fusions are obtained using a weighted strategy with a nonlinear function. To assess our novel methods, we used the correlated component analysis (CORRCA) method to investigate the efficiency and effectiveness of the proposed framework. Experimental results were obtained from a benchmark dataset of thirty-five subjects and indicate that the extended CORRCA method used within the framework significantly outperforms the original CORCCA method. Accordingly, the proposed framework holds promise to enhance the performance of frequency recognition methods in SSVEP-based BCIs.