Adversarially Robust Deep Learning with Optimal-Transport-Regularized Divergences

AIにより推定されたラベル
Abstract

We introduce the ARMORD methods as novel approaches to enhancing the adversarial robustness of deep learning models. These methods are based on a new class of optimal-transport-regularized divergences, constructed via an infimal convolution between an information divergence and an optimal-transport (OT) cost. We use these as tools to enhance adversarial robustness by maximizing the expected loss over a neighborhood of distributions, a technique known as distributionally robust optimization. Viewed as a tool for constructing adversarial samples, our method allows samples to be both transported, according to the OT cost, and re-weighted, according to the information divergence. We demonstrate the effectiveness of our method on malware detection and image recognition applications and find that, to our knowledge, it outperforms existing methods at enhancing the robustness against adversarial attacks. ARMORD yields the robustified accuracy of 98.29% against FGSM and 98.18% against PGD40 on the MNIST dataset, reducing the error rate by more than 19.7% and 37.2% respectively compared to prior methods. Similarly, in malware detection, a discrete (binary) data domain, ARMORD improves the robustified accuracy under rFGSM50 attack compared to the previous best-performing adversarial training methods by 37.0% while lowering false negative and false positive rates by 51.1% and 57.53%, respectively.

タイトルとURLをコピーしました