IEEE-INNS-ENNS International Joint Conference on Neural Networks (IJCNN'00)-Volume 3
Taxonomy of Neural Transfer Functions
Como, Italy
July 24-July 27
ISBN: 0-7695-0619-4
The choice of transfer functions may strongly influence complexity and performance of neural networks used in classification and approximation tasks. Taxonomy of activation and output functions is proposed, allowing generating many transfer functions. Several less-known types of transfer functions and new combinations of activation/output functions are described. Functions parameterize to change from localized to de-localized type; functions with activation based on non-Euclidean distance measures, bi-central functions formed from pairs of sigmoids are discussed.
Citation:
Wlodzislaw Duch, Norbert Jankowski, "Taxonomy of Neural Transfer Functions," ijcnn, vol. 3, pp.3477, IEEE-INNS-ENNS International Joint Conference on Neural Networks (IJCNN'00)-Volume 3, 2000