Autonomous collision avoidance decision-making method with human-like attention distribution for MASSs based on GMA-TD3 algorithm

• Published in: Ocean engineering Vol. 330; p. 121118
• Main Authors: Rong, Wuyue, Zheng, Jian, Chen, Yang, Liu, Yang, Zhang, Zekun
• Format: Journal Article
• Language: English
• Published: Elsevier Ltd 30.06.2025
• Subjects: Collision avoidance decision-making (CADM); Human-like attention distribution; Maritime autonomous surface ships (MASSs); Sequential collision avoidance; Twin delayed deep deterministic policy gradient (TD3); Maritime autonomous surface ships (MASSs); Collision avoidance decision-making (CADM); Human-like attention distribution; Sequential collision avoidance; Twin delayed deep deterministic policy gradient (TD3)
• ISSN: 0029-8018
• DOI: 10.1016/j.oceaneng.2025.121118

Ensuring the high-quality operation of an autonomous collision avoidance decision-making (CADM) system for Maritime Autonomous Surface Ships (MASSs) is essential for optimizing navigation safety. However, a gap remains in addressing the sequential collision avoidance problem in multi-ship encounter scenarios, which continues to present challenges for operations. To tackle the challenge, this paper proposes an autonomous CADM method based on Gated Recurrent Unit-enhanced Multi-head Attention Twin Delayed Deep Deterministic Policy Gradient (GMA-TD3) algorithm. The CADM framework consists of two main modules, a collision risk assessment module, powered by the Gated Recurrent Unit-enhanced Multi-head attention mechanism (GMA) mechanism to obtain the priority determination of obstacles based on the identified collision risk, and a motion decision module, driven by the GMA-TD3 algorithm to generate sequential collision avoidance decision with human-like attention distribution. Besides, a dual-level reward mechanism was incorporated to balance long-term goal orientation and immediate dynamic behavior. Comparative experiments show that the GMA-TD3 algorithm achieves the fastest convergence for the targeted problem and generates the shortest and smoothest trajectories. Simulation results further confirm that the proposed system accurately identifies the highest-risk obstacles before making decisions, ensuring timely and precise collision avoidance within a safe distance while fully adhering to COLREGs. •An autonomous CADM method with GMA-TD3 algorithm handles collision avoidance of MASSs.•A human-like attention mechanism tackles the anthropomorphic decision-making problem.•A GMA mechanism captures accurately highest-risk obstacle before making decisions.•GRU network allows making decisions based on previous evasive maneuvers information.•Comparative experiments show the accuracy and reliability for the targeted problem.