A p-norm variable step-size LMS algorithm for sparse system identification

• Published in: Signal, image and video processing Vol. 9; no. 7; pp. 1559 - 1565
• Main Authors: Aliyu, Muhammad Lawan, Alkassim, Mujahid Ado, Salman, Mohammad Shukri
• Format: Journal Article
• Language: English
• Published: London Springer London 01.10.2015
• Subjects: Computer Imaging; Computer Science; Image Processing and Computer Vision; Multimedia Information Systems; Original Paper; Pattern Recognition and Graphics; Signal,Image and Speech Processing; Vision; LMS algorithm; Sparse system; Zero attractor; Norm penalty
• ISSN: 1863-1703; 1863-1711
• DOI: 10.1007/s11760-013-0610-7

The performance of the least mean square (LMS) algorithm in sparse system identification has been improved by exploiting the sparsity property. This improvement is gained by adding an l 1 -norm constraint to the cost function of the LMS algorithm. However, the LMS algorithm by itself performs poorly when the condition number is relatively high due to the step size of the LMS, and the l 1 -norm LMS is an approximate method which, in turn, may not provide optimum performance. In this paper, we propose a sparse variable step-size LMS algorithm employing the p -norm constraint. This constraint imposes a zero attraction of the filter coefficients according to the relative value of each filter coefficient among all the entries which in turn leads to an improved performance when the system is sparse. The convergence analysis of the proposed algorithm is presented and stability condition is derived. Different experiments have been done to investigate the performance of the proposed algorithm. Simulation results show that the proposed algorithm outperforms different l 1 -norm- and p -norm-based sparse algorithms in a system identification setting.