Contents

1. Introduction  
2. Transformer Language Models  
3. Syntax  
4. Semantics and Pragmatics  
5. Commonsense and World Knowledge  
6. Logical and Numerical Reasoning  
7. Memorized vs. Novel Text  
8. Bias, Privacy, and Toxicity  
9. Misinformation, Personality, and Politics  
10. Discussion  
11. Conclusion