I. Introduction  
II. Overview of Reinforcement Learning  
III. Formulation of Recommendation Problem  
IV. Recommender Systems by Reinforcement Learning  
V. Challenges in Reinforcement Learning Based Recommendation Approaches  
VI. Discussion  
VII. Conclusion