Shield synthesis

• Published in: Formal methods in system design Vol. 51; no. 2; pp. 332 - 361
• Main Authors: Könighofer, Bettina, Alshiekh, Mohammed, Bloem, Roderick, Humphrey, Laura, Könighofer, Robert, Topcu, Ufuk, Wang, Chao
• Format: Journal Article
• Language: English
• Published: New York Springer US 01.11.2017; Springer Nature B.V
• Subjects: CAE) and Design; Circuits and Systems; Computer-Aided Engineering (CAD; Electrical Engineering; Engineering; Mission planning; Properties (attributes); Safety; Shielding; Shields; Software Engineering/Programming and Operating Systems; Synthesis; Unmanned aerial vehicles; Runtime reinforcement; Synthesis; UAV; Games; Human factors
• ISSN: 0925-9856; 1572-8102; 1572-8102
• DOI: 10.1007/s10703-017-0276-9

Shield synthesis is an approach to enforce safety properties at runtime. A shield monitors the system and corrects any erroneous output values instantaneously. The shield deviates from the given outputs as little as it can and recovers to hand back control to the system as soon as possible. In the first part of this paper, we consider shield synthesis for reactive hardware systems. First, we define a general framework for solving the shield synthesis problem. Second, we discuss two concrete shield synthesis methods that automatically construct shields from a set of safety properties: (1) k-stabilizing shields, which guarantee recovery in a finite time. (2) Admissible shields, which attempt to work with the system to recover as soon as possible. Next, we discuss an extension of k -stabilizing and admissible shields, where erroneous output values of the reactive system are corrected while liveness properties of the system are preserved. Finally, we give experimental results for both synthesis methods. In the second part of the paper, we consider shielding a human operator instead of shielding a reactive system: the outputs to be corrected are not initiated by a system but by a human operator who works with an autonomous system. The challenge here lies in giving simple and intuitive explanations to the human for any interferences of the shield. We present results involving mission planning for unmanned aerial vehicles.