loading...
 This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
23rd EUROMICRO Conference '97 New Frontiers of Information Technology
Automatic determination of optimal network topologies based on information theory and evolution
Budapest, HUNGARY
September 01-September 04
ISBN: 0-8186-8129-2
T. Ragg, Inst. fur Logik, Komplexitat und Deduktionssysteme, Karlsruhe Univ., Germany
S. Gutjahr, Inst. fur Logik, Komplexitat und Deduktionssysteme, Karlsruhe Univ., Germany
Presents a new approach to determine the optimal topology of multilayer perceptrons for a given learning task, based on information theory and evolution. Our method exploits the mutual information of the input-output relation to sort the units into a list with respect to their information content. Embedded in a evolutionary algorithm, a mutation operator is proposed which removes or adds input units from given networks based on their ranking. The power of the approach is demonstrated on several benchmarks. We conclude that using an evolutionary algorithm as a framework in conjunction with intelligent mutation operators is concurrently the most efficient optimization technique with regard to network size and performance as well as scalability.
Index Terms:
network topology; optimal network topology; automatic topology determination; information theory; evolution; multilayer perceptrons; learning task; input-output relation; neural unit sorting; list; information content; evolutionary algorithm; intelligent mutation operator; input unit ranking; benchmarks; efficient optimization technique; network size; network performance; network scalability
Citation:
T. Ragg, S. Gutjahr, "Automatic determination of optimal network topologies based on information theory and evolution," euromicro, pp.549, 23rd EUROMICRO Conference '97 New Frontiers of Information Technology, 1997
Usage of this product signifies your acceptance of the Terms of Use.