I. INTRODUCTION

II. CATEGORIZATION OF DNN COMPRESSION TECHNIQUES

III. NETWORK PRUNING

IV. SPARSE REPRESENTATION

V. BITS PRECISION

VI. KNOWLEDGE DISTILLATION

VII. MISCELLANEOUS

VIII. DISCUSSIONS AND FUTURE RESEARCH DIRECTIONS