A BSTRACT

1 Introduction

2 Recurrent Models in Sequence Processing

3 Transformers Embracing Recurrent Models

4 Deep State-Space Models

5 Enhancing Recurrent Neural Networks

6 Learning in Recurrent Models

7 Benchmarks

8 Discussion and Future Directions

9 Conclusions