1 Introduction

2 Brief Overview of Deep Neural Networks

3 Deep Learning Architectures Outside of Deep Neural Networks

4 Deep Learning Optimization Outside of Deep Neural Networks

5 Deep Learning Regularization Outside of Deep Neural Networks

6 Hybrid Models

7 Experiments

8 Conclusions and Directions for Ongoing Research