Stability of simultaneous recurrent neural network dynamics for static optimization

• Published in: Proceedings of the 2002 International Joint Conference on Neural Networks. IJCNN'02 (Cat. No.02CH37290) Vol. 3; pp. 2023 - 2028 vol.3
• Main Authors: Serpen, G., Yifeng Xu
• Format: Conference Proceeding
• Language: English
• Published: IEEE 2002
• Subjects: Backpropagation algorithms; Computational efficiency; Computational modeling; Computer networks; Large-scale systems; Parallel processing; Recurrent neural networks; Stability; Stochastic processes; Strontium
• ISBN: 0780372786; 9780780372788
• ISSN: 1098-7576
• DOI: 10.1109/IJCNN.2002.1007450

A new trainable and recurrent neural optimization algorithm, which has potentially superior capabilities compared to existing neural search algorithms to compute high quality solutions of static optimization problems in a computationally efficient manner, is studied. Specifically, a local stability analysis of the dynamics of a relaxation-based recurrent neural network, the simultaneous recurrent neural network, for static optimization problems is presented. The results of theoretical as well as its correlated simulation study lead to the conjecture that the simultaneous recurrent neural network dynamics appears to demonstrate desirable stability characteristics. Dynamics often converge to fixed points upon conclusion of a relaxation cycle, which facilitates adaptation of weights through one of many fixed-point training algorithms. The trainability of this neural algorithm results relatively high quality solutions to be computed for large-scale problem instances with computational efficiency, particularly when compared to solutions computed by the Hopfield network and its derivative algorithms including those with stochastic search control mechanisms.