I. Introduction

II. Evaluation Metrics

III. Search for Efficient Deep Learning Models

IV. Automated Compression of Deep Learning Models

V. Joint Automated Design Strategies

VI. Future Directions

VII. Conclusion