I. Introduction  
II. Parameter Quantization and Pruning  
III. Convolutional Filter Compression and Matrix Factorization  
IV. Network Architecture Search  
V. Knowledge Transfer and Distillation  
VI. Discussion  
VII. Summary and Conclusions