loading...
 This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
First International Conference on Innovative Computing, Information and Control - Volume III (ICICIC'06)
Information Geometry Approach to the Model Selection of Neural Networks
Beijing, China
August 30-September 01
ISBN: 0-7695-2616-0
Ziang Lv, Beijing Jiaotong University, China
Siwei Luo, Beijing Jiaotong University, China
Yunhui Liu, Beijing Jiaotong University, China
Yu Zheng, Beijing Jiaotong University, China
Model selection is an efficient method to overcome the over-fitting problem of large-scale neural networks. The crux of model selection is generalization. To obtain good generalization we must make balance between the goodness of fit and the complexity of the model. Most of present methods only focus on the parameters of model, which cannot describe the intrinsic complexity of the model. Information geometry is the application of differential geometry in statistical. We studied on the model selection of neural networks use the information geometry method. We propose that the Gauss- Kronecker curvature of the statistical manifold is the natural measurement of the non-linearity of the manifold. This approach provides a clear intuitive understanding of the model complexity.
Citation:
Ziang Lv, Siwei Luo, Yunhui Liu, Yu Zheng, "Information Geometry Approach to the Model Selection of Neural Networks," icicic, vol. 3, pp.419-422, First International Conference on Innovative Computing, Information and Control - Volume III (ICICIC'06), 2006
Usage of this product signifies your acceptance of the Terms of Use.