An Analysis Dictionary Learning Algorithm under a Noisy Data Model with Orthogonality Constraint

• Published in: TheScientificWorld Vol. 2014; no. 2014; pp. 1 - 8
• Main Authors: Zhang, Ye, Wang, Wenwu, Yu, Tenglong
• Format: Journal Article
• Language: English
• Published: Cairo, Egypt Hindawi Publishing Corporation 01.01.2014; John Wiley & Sons, Inc; Wiley
• Subjects: Algorithms; Artificial Intelligence; Computational linguistics; Computer Simulation; Dictionaries; Dictionaries as Topic; Language processing; Machine learning; Methods; Models, Theoretical; Natural language interfaces; Noise; Noise levels; Optimization; Signal processing
• ISSN: 2356-6140; 1537-744X; 1537-744X
• DOI: 10.1155/2014/852978

Two common problems are often encountered in analysis dictionary learning (ADL) algorithms. The first one is that the original clean signals for learning the dictionary are assumed to be known, which otherwise need to be estimated from noisy measurements. This, however, renders a computationally slow optimization process and potentially unreliable estimation (if the noise level is high), as represented by the Analysis K-SVD (AK-SVD) algorithm. The other problem is the trivial solution to the dictionary, for example, the null dictionary matrix that may be given by a dictionary learning algorithm, as discussed in the learning overcomplete sparsifying transform (LOST) algorithm. Here we propose a novel optimization model and an iterative algorithm to learn the analysis dictionary, where we directly employ the observed data to compute the approximate analysis sparse representation of the original signals (leading to a fast optimization procedure) and enforce an orthogonality constraint on the optimization criterion to avoid the trivial solutions. Experiments demonstrate the competitive performance of the proposed algorithm as compared with three baselines, namely, the AK-SVD, LOST, and NAAOLA algorithms.