1 INTRODUCTION

2 PRELIMINARIES OF GRAPH NEURAL NETWORKS

3 DISTRIBUTED GNN TRAINING AND CHALLENGES

4 GNN DATA PARTITION

5 GNN BATCH GENERATION

6 GNN EXECUTION MODEL

7 GNN COMMUNICATION PROTOCOLS

8 DISTRIBUTED GNN TRAINING SYSTEMS

9 FUTURE DIRECTION

10 CONCLUSION