Mixture quantized error entropy for recursive least squares adaptive filtering

• Published in: Journal of the Franklin Institute Vol. 359; no. 3; pp. 1362 - 1381
• Main Authors: He, Jiacheng, Wang, Gang, Peng, Bei, Sun, Qi, Feng, Zhenyu, Zhang, Kun
• Format: Journal Article
• Language: English
• Published: Elmsford Elsevier Ltd 01.02.2022; Elsevier Science Ltd
• Subjects: Adaptive algorithms; Adaptive filters; Algorithms; Criteria; Electroencephalography; Entropy; Information theory; Kernel functions; Learning; Least squares; Machine learning; Mixtures; Optimization; Performance enhancement; Robustness; Signal processing
• ISSN: 0016-0032; 1879-2693; 0016-0032
• DOI: 10.1016/j.jfranklin.2021.12.015

Error entropy is a well-known learning criterion in information theoretic learning (ITL), and it has been successfully applied in robust signal processing and machine learning. To date, many robust learning algorithms have been devised based on the minimum error entropy (MEE) criterion, and the Gaussian kernel function is always utilized as the default kernel function in these algorithms, which is not always the best option. To further improve learning performance, two concepts using a mixture of two Gaussian functions as kernel functions, called mixture error entropy and mixture quantized error entropy, are proposed in this paper. We further propose two new recursive least-squares algorithms based on mixture minimum error entropy (MMEE) and mixture quantized minimum error entropy (MQMEE) optimization criteria. The convergence analysis, steady-state mean-square performance, and computational complexity of the two proposed algorithms are investigated. In addition, the reason why the mixture mechanism (mixture correntropy and mixture error entropy) can improve the performance of adaptive filtering algorithms is explained. Simulation results show that the proposed new recursive least-squares algorithms outperform other RLS-type algorithms, and the practicality of the proposed algorithms is verified by the electro-encephalography application.