Robustifying models against adversarial attacks by Langevin dynamics

• Published in: Neural networks Vol. 137; pp. 1 - 17
• Main Authors: Srinivasan, Vignesh, Rohrer, Csaba, Marban, Arturo, Müller, Klaus-Robert, Samek, Wojciech, Nakajima, Shinichi
• Format: Journal Article
• Language: English
• Published: United States Elsevier Ltd 01.05.2021
• Subjects: Adversarial examples; Langevin dynamics; Robustness; Adversarial examples; Robustness; Langevin dynamics
• ISSN: 0893-6080; 1879-2782; 1879-2782
• DOI: 10.1016/j.neunet.2020.12.024

Adversarial attacks on deep learning models have compromised their performance considerably. As remedies, a number of defense methods were proposed, which however, have been circumvented by newer and more sophisticated attacking strategies. In the midst of this ensuing arms race, the problem of robustness against adversarial attacks still remains a challenging task. This paper proposes a novel, simple yet effective defense strategy where off-manifold adversarial samples are driven towards high density regions of the data generating distribution of the (unknown) target class by the Metropolis-adjusted Langevin algorithm (MALA) with perceptual boundary taken into account. To achieve this task, we introduce a generative model of the conditional distribution of the inputs given labels that can be learned through a supervised Denoising Autoencoder (sDAE) in alignment with a discriminative classifier. Our algorithm, called MALA for DEfense (MALADE), is equipped with significant dispersion—projection is distributed broadly. This prevents white box attacks from accurately aligning the input to create an adversarial sample effectively. MALADE is applicable to any existing classifier, providing robust defense as well as off-manifold sample detection. In our experiments, MALADE exhibited state-of-the-art performance against various elaborate attacking strategies.