loading...
 This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
4th Brazilian Symposium on Neural Networks (SBRN '97)
Stability analysis of pRAM reinforcement learning
Campos do Jordao, BRAZIL
December 03-December 05
ISBN: 0-8186-8070-9
Generalisation has been a major issue in RAM-based neural networks. In pRAM networks generalisation is produced by noisy reinforcement learning-a completely hardware implementable (built-in) algorithm. This paper presents the first part of a modular technique to analyse the formation of the basins of attraction in such systems. It proves that reinforcement learning in a single pRAM site is a globally stable system in the continuous limit of incremental learning. It also shows how the stable state depends on the penalty/reward ratio and on the learning rate. The evolution of learning in the time domain shows the effects of the initial state and of the halting moment in the final state. The paper ends with considerations on how noise contributes to the formation of basins of attraction in pRAM neurons.
Index Terms:
neural chips; reinforcement learning; pRAM networks; generalisation; RAM-based neural networks; basins of attraction; penalty/reward ratio; time domain; noise; stability; neural net chip; pattern recognition
Citation:
P.J.L. Adeodato, J.G. Taylor, "Stability analysis of pRAM reinforcement learning," sbrn, pp.41, 4th Brazilian Symposium on Neural Networks (SBRN '97), 1997
Usage of this product signifies your acceptance of the Terms of Use.