IEEE-INNS-ENNS International Joint Conference on Neural Networks (IJCNN'00)-Volume 1
Technique of Learning Rate Estimation for Efficient Training of MLP
Como, Italy
July 24-July 27
ISBN: 0-7695-0619-4
A new computational technique for training of multilayer feed-forward neural networks with sigmoid activation function of the units is proposed. The proposed algorithm consists two phases. The first phase is an adaptive training step calculation, which implements the steepest descent method in the weight space. The second phase is estimation of calculated training step rate, which provide reach a state of activity of the units on the each training iteration. The simulation results are provided for the test example to demonstrate the efficiency of the proposed method, which solves the problem of training step choice in multilayer perceptions.
Citation:
Vladimir Golovko, Yury Savitsky, A. Sachenko, T. Laopoulo, L. Grandinetti, "Technique of Learning Rate Estimation for Efficient Training of MLP," ijcnn, vol. 1, pp.1323, IEEE-INNS-ENNS International Joint Conference on Neural Networks (IJCNN'00)-Volume 1, 2000