1 Introduction  
2 Challenges in Reinforcement Learning  
3 Foundations of Diffusion Models  
4 The Roles of Diffusion Models in RL  
5 Applications of Diffusion Models  
6 Summary and Future Prospects