1 MODEL COMPRESSION METHODS: OVERVIEW

2 PRUNING

3 QUANTIZATION

4 KNOWLEDGE DISTILLATION (KD)

5 PARAMETER SHARING

6 TENSOR DECOMPOSITION

7 TRANSFORMERS WITH SUB-QUADRATIC COMPLEXITY

8 SUMMARY AND FUTURE DIRECTIONS