Trust or Bust: Ensuring Trustworthiness in Autonomous Weapon Systems

• Published in: MILCOM IEEE Military Communications Conference pp. 182 - 189
• Main Authors: Cools, Kasper, Maathuis, Clara
• Format: Conference Proceeding
• Language: English
• Published: IEEE 28.10.2024
• Subjects: Artificial intelligence; AWS; Collaboration; Decision making; Ethics; Human-machine systems; Law; military; systematic review; Testing; Training; Transforms; trust; Weapons
• ISSN: 2155-7586
• DOI: 10.1109/MILCOM61039.2024.10773908

The integration of Autonomous Weapon Systems (AWS) into military operations presents both significant opportunities and challenges. This paper explores the multifaceted nature of trust in AWS, emphasising the necessity of establishing reliable and transparent systems to mitigate risks associated with bias, operational failures, and accountability. Despite advancements in Artificial Intelligence (AI), the trustworthiness of these systems, especially in high-stakes military applications, remains a critical issue. Through a systematic literature review, this research identifies gaps in the understanding of trust dynamics during the development and deployment phases of AWS. It advocates for a collaborative approach that includes technologists, ethicists, and military strategists to address these ongoing challenges. The findings underscore the importance of Human-Machine teaming and enhancing system intelligibility to ensure accountability and adherence to law. Ultimately, this paper aims to contribute to the ongoing discourse on the ethical implications of AWS and the imperative for trustworthy AI in defense contexts.