A New Reinforcement Learning Fault-Tolerant Tracking Control Method With Application to Baxter Robot

• Published in: IEEE/ASME transactions on mechatronics Vol. 29; no. 2; pp. 1331 - 1341
• Main Authors: Zhu, Jun-Wei, Dong, Zi-Yuan, Yang, Zhi-Jun, Wang, Xin
• Format: Journal Article
• Language: English
• Published: New York IEEE 01.04.2024; The Institute of Electrical and Electronics Engineers, Inc. (IEEE)
• Subjects: Actuators; Adaptation models; Adaptive control; Algorithms; Baxter robot; Control methods; Estimation; Fault tolerance; Fault tolerant systems; flexible multijoint manipulator; Machine learning; Manipulators; model-free fault-tolerant control (FTC); Neural networks; Observers; Parameter estimation; Parameter identification; Radial basis function; reinforcement learning (RL); Robot arms; Robot control; Robots; Tracking control
• ISSN: 1083-4435; 1941-014X
• DOI: 10.1109/TMECH.2023.3309888

The fault-tolerant control problem of the flexible multijoint manipulator is a difficult issue due to its strong nonlinearity and coupling. This article proposes a reinforcement learning (RL) based model-free adaptive fault-tolerant control (MFAFTC) algorithm for the multi-joint manipulator. First, a parameter estimation mode switching mechanism is designed based on the two dimensions of the time axis and the sampling period, where an iterative estimation structure is introduced to identify some key parameters online accurately. Meanwhile, the radial basis function neural network is used to identify the spring interference as well as actuator fault, and a compensation fault-tolerant control strategy is proposed. Moreover, the computation complexity is optimized via designing the critic-actor mechanism with an event-trigger parameter selection strategy. Finally, the superiority and effectiveness of the proposed method are verified by the application to the Baxter robot.