loading...
 This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
IEEE-INNS-ENNS International Joint Conference on Neural Networks (IJCNN'00)-Volume 1
On the Combination of Weight-Decay and Input Selection Methods
Como, Italy
July 24-July 27
ISBN: 0-7695-0619-4
Mercedes Fernández-Redondo, Universidad Jaume I
Carlos Hernández-Espinosa, Universidad Jaume I
In this paper, we present the results of a research on the combination of weight-decay and input selection methods based on the analysis of a trained multilayer feedforward network. This combination was proposed and suggested by some authors. The influence of weight-decay in seventeen different input selection methods is empirically analyzed with eight classification problems. We show that the performance variation by introducing weight-decay strongly depends on the particular input selection method. The use of weight-decay can even deteriorate the efficiency of a method. Furthermore, it seems that weight-decay improves the performance of the worst input selection methods and deteriorate the performance of the best ones. In that sense, it diminishes the performance differences among different methods. We think that the combination of weight-decay and this type of input selection methods should be avoided.
Citation:
Mercedes Fernández-Redondo, Carlos Hernández-Espinosa, "On the Combination of Weight-Decay and Input Selection Methods," ijcnn, vol. 1, pp.1191, IEEE-INNS-ENNS International Joint Conference on Neural Networks (IJCNN'00)-Volume 1, 2000
Usage of this product signifies your acceptance of the Terms of Use.