I. Introduction

II. Definition of Terms

III. Adversarial Attacks: The Formal Problem

IV. First-Generation Attacks

V. Recent Attacks on Classifiers

VI. Attacks Beyond Classification

VII. Physical World Attacks

VIII. Beyond Adversarial Objective

IX. On the Existence of Adversarial Examples

X. Defense Against Adversarial Attacks

XI. Discussion

XII. Conclusion