1. Introduction

2. Evolution of Activation Functions

3. Logistic Sigmoid and Tanh Based Activation Functions

4. Rectified Activation Functions

5. Exponential Activation Functions

6. Learning/Adaptive Activation Functions

7. Miscellaneous Activation Functions

8. Aspects of Activation Functions

9. Performance Comparison and Analysis

10. Conclusion and Recommendations