Transient Analysis of the Set-Membership LMS Algorithm

• Published in: IEEE communications letters Vol. 25; no. 4; pp. 1298 - 1302
• Main Authors: Siqueira, Newton N., Ferreira, Tiago P., Resende, Leonardo C., Pimenta, Rodrigo M. S., Haddad, Diego B., Petraglia, Mariane R.
• Format: Journal Article
• Language: English
• Published: New York IEEE 01.04.2021; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Adaptation models; Adaptive algorithms; Adaptive filters; Algorithms; Iterative methods; Least mean squares; Least mean squares algorithm; Mathematical model; Optimization; Prediction algorithms; set-membership algorithms; Steady state; Stochastic models; Stochastic processes; Transfer functions; Transient analysis; Transient performance
• ISSN: 1089-7798; 1558-2558
• DOI: 10.1109/LCOMM.2021.3051007

Adaptive filtering algorithms, which adopt the set-membership strategy, are able to attain good steady-state performance with low computational burden. In general, such advantages are obtained by defining a bounded-error. This specification translates into a time-variant step size, chosen in each iteration according to a nonlinear function of the instantaneous error. Unfortunately, this type of nonlinear behaviour hampers the stochastic modelling of these algorithms. This work devises a novel transient analysis of the Set-Membership Least Mean Squares algorithm. Additionally, a new interpretation is advanced about the implicit optimization problem solved by the algorithm. This explanation is important since it can contribute to the design of new adaptive algorithms. The proposed theoretical analysis provides predictions for: (i) steady-state performance; (ii) transient performance; and (iii) evolution of the update probability. It is noteworthy that the latter influences the computational complexity of the algorithm. Furthermore, we perform a novel comprehensive transient analysis of a set-membership algorithm. In addition, both time-variant transfer functions and deficient-length configurations are addressed. The resulting theoretical estimates are confirmed by simulations.