A BSTRACT  
1 Introduction  
2 Background  
3 Activation Function Properties  
4 Challenges Faced by Activation Functions  
5 Different Types of Activation Functions  
6 Alternative Solutions for Challenges Faced by Activation Functions  
7 Biologically Inspired Oscillating Activation Functions  
8 Conclusion