An Effective Neural Learning Algorithm for Extracting Cross-Correlation Feature Between Two High-Dimensional Data Streams

• Published in: Neural processing letters Vol. 42; no. 2; pp. 459 - 477
• Main Authors: Kong, Xiang-yu, Ma, Hong-guang, An, Qiu-sheng, Zhang, Qi
• Format: Journal Article
• Language: English
• Published: New York Springer US 01.10.2015; Springer Nature B.V
• Subjects: Algorithms; Artificial Intelligence; Asymptotic properties; Complex Systems; Computational Intelligence; Computer Science; Correlation analysis; Criteria; Cross correlation; Data transmission; Gradient flow; Hierarchies; Machine learning; Mathematical analysis; Neural networks; Owls; Stability analysis; Subspaces; SVD; Global asymptotic stability; Cross-correlation neural networks; Nonquadratic criterion; Cross-correlation features; Principal singular subspace
• ISSN: 1370-4621; 1573-773X
• DOI: 10.1007/s11063-014-9367-4

A novel information criterion for principal singular subspace tracking is proposed and a corresponding principal singular subspace gradient flow is derived based on the information criterion in this paper. The information criterion exhibits a unique global minimum attained if and only if the state matrices of the left and right neural networks span the left and right principal singular subspace of a cross-correlation matrix between two high-dimensional vector sequences, respectively. The proposed gradient flow can efficiently track an orthonormal basis of the principal singular subspace, and it has fast convergence speed, good suitability for data matrix close to singular matrix and excellent self-stabilizing property. The global asymptotic stability and self-stabilizing property of the proposed algorithm are analyzed. The simulation experiments validate the excellent performance of the proposed algorithm.