1 Introduction  

2 A taxonomy of activation functions  

3 Fixed-shape activation functions  

4 Trainable activation functions  

5 Trainable non-standard neuron definitions  

6 Performance and experimental architecture comparison  

7 Conclusions