1. Introduction

2. Background on Mixture of Experts

3. Taxonomy of Mixture of Experts

4. Algorithm Design of Mixture of Experts

5. System Design of Mixture of Experts

6. Applications of Mixture of Experts

7. Challenges & Opportunities

8. Conclusion