1 INTRODUCTION

2 OVERVIEW

3 EFFICIENT ATTENTION

4 LONG-TERM MEMORY

5 EXTRAPOLATIVE POSITIONAL EMBEDDINGS

6 CONTEXT PROCESSING

7 MISCELLANEOUS

8 EVALUATION NECESSITY & OPTIMIZATION TOOLKIT

9 DISCUSSION

10 CONCLUSION