|
| This Article | ||
| ||
| Share | ||
| Bibliographic References | ||
| Add to: | ||
| | ||
| Search | ||
| ||
IEEE-INNS-ENNS International Joint Conference on Neural Networks (IJCNN'00)-Volume 2
Training Feedforward Neural Networks Using Orthogonal Iteration of the Hessian Eigenvectors
Como, Italy
July 24-July 27
ISBN: 0-7695-0619-4
| ASCII Text | x | ||
| Andrew Hunter, "Training Feedforward Neural Networks Using Orthogonal Iteration of the Hessian Eigenvectors," Neural Networks, IEEE - INNS - ENNS International Joint Conference on, vol. 2, pp. 2173, IEEE-INNS-ENNS International Joint Conference on Neural Networks (IJCNN'00)-Volume 2, 2000. | |||
| BibTex | x | ||
| @article{ 10.1109/IJCNN.2000.857893, author = {Andrew Hunter}, title = {Training Feedforward Neural Networks Using Orthogonal Iteration of the Hessian Eigenvectors}, journal ={Neural Networks, IEEE - INNS - ENNS International Joint Conference on}, volume = {2}, year = {2000}, issn = {1098-7576}, pages = {2173}, doi = {http://doi.ieeecomputersociety.org/10.1109/IJCNN.2000.857893}, publisher = {IEEE Computer Society}, address = {Los Alamitos, CA, USA}, } | |||
| RefWorks Procite/RefMan/Endnote | x | ||
| TY - CONF JO - Neural Networks, IEEE - INNS - ENNS International Joint Conference on TI - Training Feedforward Neural Networks Using Orthogonal Iteration of the Hessian Eigenvectors SN - 1098-7576 SP EP A1 - Andrew Hunter, PY - 2000 VL - 2 JA - Neural Networks, IEEE - INNS - ENNS International Joint Conference on ER - | |||
The paper describes a new training algorithm that has scalable memory requirements, which may range horn O(W) to O(W2), although in practice the useful range is limited to lower complexity levels. The algorithm is based upon a novel iterative estimation of the principal eigen-subspace of the Hessian, together with a quadratic step estimation procedure. It is shown that the new algorithm has convergence time comparable to conjugate gradient descent and maybe preferable if early stopping is used as it converges more quickly during the initial phases. Section 2 overviews the principles of second order training algorithms. Section 3 introduces the new algorithm. Second 4 discusses some experiments to confirm the algorithm's performance; section 5 concludes the paper.
Citation:
Andrew Hunter, "Training Feedforward Neural Networks Using Orthogonal Iteration of the Hessian Eigenvectors," ijcnn, vol. 2, pp.2173, IEEE-INNS-ENNS International Joint Conference on Neural Networks (IJCNN'00)-Volume 2, 2000
Usage of this product signifies your acceptance of the Terms of Use.
