1 Introduction  
2 Background  
3 Cooperative Multi-agent Reinforcement Learning in Classical Environments  
4 Cooperative Multi-agent Reinforcement Learning in Open Environments  
5 Summary and Prospect