Reinforcement Learning for Robust Neuro-Control of Constrained Nonlinear Systems

• Published in: 2022 4th International Conference on Data-driven Optimization of Complex Systems (DOCS) pp. 1 - 6
• Main Authors: Xu, Mengmeng, Yang, Xiong
• Format: Conference Proceeding
• Language: English
• Published: IEEE 28.10.2022
• Subjects: Adaptive dynamic programming; Adaptive systems; Artificial neural networks; asymmetric constraint; Monte Carlo methods; neural network; Nonlinear systems; Optimal control; Reinforcement learning; robust control; Upper bound
• DOI: 10.1109/DOCS55193.2022.9967737

This article considers the robust neuro-control problem of unknown nonlinear systems subject to asymmetric input constraints. Initially, with a discounted value function being introduced for the nominal systems associated with the studied nonlinear systems, the robust constrained control problem is converted into a nonlinear-constrained optimal control problem. Then, in the reinforcement learning framework, an actor-critic architecture is employed to solve the nonlinear-constrained optimal control problem. Two neural networks (NNs) are utilized to implement such an architecture. Specifically, the actor and critic NNs are, respectively, constructed to approximate the control policy and the value function simultaneously. Meanwhile, the actor and critic NNs' weights are determined via the least square method and the Monte-Carlo integration technique. Finally, simulations of a nonlinear plant are provided to validate the theoretical results.