I. Introduction

II. Background

III. Large Language Model-Enhanced Reinforcement Learning

IV. LLM as Information Processor

V. LLM as Reward Designer

VI. LLM as Decision-Maker

VII. LLM as Generator

VIII. Discussion

IX. Conclusion