Contents

1 Introduction

2 Background on Offline Policy Learning

3 Variational Auto-Encoders in Offline Policy Learning

4 Generative Adversarial Networks in Offline Policy Learning

5 Normalizing Flows in Offline Policy Learning

6 Transformers in Offline Policy Learning

7 Diffusion Models in Offline Policy Learning

8 Discussions and Open Problems

9 Conclusion