I. INTRODUCTION  
II. BACKGROUND ON DEEP NEURAL NETWORKS (DNNs)  
III. HARDWARE SOLUTIONS AND CO-DESIGN  
IV. MEMORY HIERARCHY  
V. DEEP LEARNING SECURITY  
VI. BENCHMARKING  
VII. CHALLENGES AND THE ROAD AHEAD  
VIII. DISTINCTION FROM OTHER SURVEYS  
IX. CONCLUSION  