IEEE-INNS-ENNS International Joint Conference on Neural Networks (IJCNN'00)-Volume 1
Training Feedforward Neural Networks with the Dogleg Method and BFGS Hessian Updates
Como, Italy
July 24-July 27
ISBN: 0-7695-0619-4
In this paper, we introduce an advanced optimization algorithm for training feedforward neural networks. The algorithm combines the BFGS Hessian update formula with a special case of trust region techniques, called the Dogleg method, as an altenative technique to line search methods. Simulations regarding classification and function approximation problems are presented which reveal a clear improvement both in convergence and success rates over standard BFGS implementations.
Citation:
S.J. Perantonis, N. Ampazis, S. Spirou, "Training Feedforward Neural Networks with the Dogleg Method and BFGS Hessian Updates," ijcnn, vol. 1, pp.1138, IEEE-INNS-ENNS International Joint Conference on Neural Networks (IJCNN'00)-Volume 1, 2000