Off-policy reinforcement-learning-based fault-tolerant H∞ control for topside separation systems with time-varying uncertainties

• Published in: ISA transactions Vol. 156; pp. 11 - 19
• Main Authors: Zhang, Yuguang, Wang, Juan, Li, Shaobao, Luo, Xiaoyuan, Guan, Xinping
• Format: Journal Article
• Language: English
• Published: United States Elsevier Ltd 01.01.2025
• Subjects: Fault-tolerant control; Off-policy reinforcement learning; Robust Control; Structural uncertainties; Topside separation system; Robust Control; Structural uncertainties; Fault-tolerant control; Topside separation system; Off-policy reinforcement learning
• ISSN: 0019-0578; 1879-2022; 1879-2022
• DOI: 10.1016/j.isatra.2024.11.002

The topside separation system plays a pivotal role in the treatment of produced water within offshore oil and gas production operations. Due to high-humidity and salt-infested marine environments, topside separation systems are susceptible to dynamic model variations and valve faults. In this work, fault-tolerant control (FTC) of topside separation systems subject to structural uncertainties and slugging disturbances is studied. The system is configured as a cascade structure, comprising a water level control subsystem and a pressure-drop-ratio (PDR) control subsystem. A fault-tolerant H∞ control framework is developed to cope with actuator faults and slugging disturbances. To enhance control performance in the presence of actuator faults and model uncertainties while reducing sensitivity to slugging disturbances, the fault-tolerant H∞ control problem for the topside separation system is established as the two-player differential game problem. In addition, a Nash equilibrium solution for the fault-tolerant H∞ control problem is achieved through the solution of the game algebraic Riccati equation (GARE). A model-free approach is presented to implement the proposed fault-tolerant H∞ control method using off-policy reinforcement learning (RL). Simulation studies demonstrate the effectiveness of the solution. •The Fault-Tolerant H∞ control for topside separation is framed as a two-player zero-sum game.•An active FTC scheme using optimal game Riccati solutions addresses slugging, uncertainties, and faults.•An off-policy RL-based FTC algorithm enables model-based active control without system dynamics.