1. Introduction  
2. Formal Approaches from Different Domains that Model Non-Stationarity  
3. Learning in Multiagent Environments  
4. Illustrative Example - Iterated Prisoner's Dilemma  
5. Algorithms  
6. Discussion  
7. Conclusions