1 INTRODUCTION

2 GPT AND GPT-LIKE MODELS

3 PRE-TRAINING AND FINE-TUNING DATA

4 DEPLOYMENT AND FINE-TUNING TECHNIQUES

5 OPEN-SOURCE TOOLS

6 BENCHMARK EVALUATIONS

7 HUMAN EVALUATION

8 MULTIMODAL GPT MODELS AND EVALUATION

9 SCIENTIFIC GPT MODELS AND EVALUATION

10 MISCS

11 CONCLUSION AND FUTURE DIRECTIONS