23rd EUROMICRO Conference '97 New Frontiers of Information Technology Automatic determination of optimal network topologies based on information theory and evolution Budapest, HUNGARY September 01-September 04 ISBN: 0-8186-8129-2
Presents a new approach to determine the optimal topology of multilayer perceptrons for a given learning task, based on information theory and evolution. Our method exploits the mutual information of the input-output relation to sort the units into a list with respect to their information content. Embedded in a evolutionary algorithm, a mutation operator is proposed which removes or adds input units from given networks based on their ranking. The power of the approach is demonstrated on several benchmarks. We conclude that using an evolutionary algorithm as a framework in conjunction with intelligent mutation operators is concurrently the most efficient optimization technique with regard to network size and performance as well as scalability.
Index Terms:
network topology; optimal network topology; automatic topology determination; information theory; evolution; multilayer perceptrons; learning task; input-output relation; neural unit sorting; list; information content; evolutionary algorithm; intelligent mutation operator; input unit ranking; benchmarks; efficient optimization technique; network size; network performance; network scalability
Citation:
T. Ragg, S. Gutjahr, "Automatic determination of optimal network topologies based on information theory and evolution," euromicro, pp.549, 23rd EUROMICRO Conference '97 New Frontiers of Information Technology, 1997 Usage of this product signifies your acceptance of the Terms of Use. | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||