I. Introduction

II. Representation of Gender Bias

III. Why Does Gender Bias Occur?

IV. Transformers and Gender Bias

V. Examining Gender Bias Detection Techniques in Transformer Models

VI. Overview of Gender Bias Estimation Techniques in Transformer Models

VII. Discussion

VIII. Conclusion and Future Works