Deep Nonnegative Matrix Factorization with Joint Global and Local Structure Preservation

• Published in: Expert systems with applications Vol. 249; no. B; p. 123645
• Main Authors: Saberi-Movahed, Farid, Biswas, Bitasta, Tiwari, Prayag, Lehmann, Jens, Vahdati, Sahar
• Format: Journal Article
• Language: English
• Published: Elsevier Ltd 01.09.2024
• Subjects: Deep Non-negative Matrix Factorization; Global structure; Local structure; Non-negative Matrix Factorization; Sparsity; Non-negative Matrix Factorization; Global structure; Local structure; Deep Non-negative Matrix Factorization; Sparsity
• ISSN: 0957-4174; 1873-6793; 1873-6793
• DOI: 10.1016/j.eswa.2024.123645

Deep Non-Negative Matrix Factorization (DNMF) methods provide an efficient low-dimensional representation of given data through their layered architecture. A limitation of such methods is that they cannot effectively preserve the local and global geometric structures of the data in each layer. Consequently, a significant amount of the geometrical information within the data, present in each layer of the employed deep framework, can be overlooked by the model. This can lead to an information loss and a subsequent drop in performance. In this paper, we propose a novel deep non-negative matrix factorization method, Deep Non-Negative Matrix Factorization with Joint Global and Local Structure Preservation (dubbed Dn2MFGL), that ensures the preservation of both global and local structures within the data space. Dn2MFGL performs representation learning through a sequential embedding procedure which involves both the global data structure by accounting for the data variance, and the local data relationships by utilizing information from neighboring data points. Moreover, a regularization term that promotes sparsity by utilizing the concept of the inner product is applied to the matrices representing the lower dimensions. This aims to retain the fundamental data structure while discarding less crucial features. Simultaneously, the residual matrix of Dn2MFGL is subjected to the L2,1 norm, which ensures the robustness of the model against noisy data samples. An effective and multiplicative updating process also facilitates Dn2MFGL in solving the employed objective function. The clustering performance of the proposed deep NMF method is explored across various benchmarks of face datasets. The results point to Dn2MFGL outperforming several existing classical and state-of-the-art NMF methods. The source code is available at https://github.com/FaridSaberi/Dn2MFGO.git. •Dn2MFGL preserves global/local data structures at each layer.•Dn2MFGL uses the L2,1 norm for robust factorization outcome.•Dn2MFGL employs inner product sparsity for coefficient matrices.