1. INTRODUCTION  
2. TECHNICAL FOUNDATIONS  
3. REINFORCEMENT LEARNING FOR SEARCH  
4. REINFORCEMENT LEARNING FOR RECOMMENDATION  
5. REINFORCEMENT LEARNING FOR ONLINE ADVERTISING  
6. CONCLUSION AND FUTURE DIRECTIONS