I. Introduction

II. Background

III. Taxonomy of Distributed GNN Training

IV. Distributed Full-batch Training

V. Distributed Mini-batch Training

VI. Software Frameworks for Distributed GNN Training

VIII. Comparison to Distributed DNN Training

IX. Summary and Discussion