This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
2013 International Conference on Information Networking (ICOIN)
Self-evaluating reinforcement learning based spectrum management for cognitive Ad Hoc networks
Bangkok Thailand
January 28-January 30
ISBN: 978-1-4673-5740-1
E. Eylem Ozekin, Dept. of Computer Engineering Bogazici University Istanbul, Turkey
F. Cihan Demirci, Dept. of Computer Engineering Dogus University Istanbul, Turkey
Fatih Alagoz, Dept. of Computer Engineering Bogazici University Istanbul, Turkey
Cognitive radio (CR) is an emerging technology which aims to solve the current wireless spectra problems in terms of efficiency and utilization. CRs should respond adequately to environmental changes in order to operate in a highly efficient manner. Reinforcement learning (RL) is an effective method that entails exploration, followed by exploitation and is used to train CRs to function in unknown environments. However, it also suffers from cases that cannot be easily avoided and recovered from, such as: conservative behavior causing converging to a non-ideal state and aggressive exploration that results in disrupting the network. In this paper, we propose a self-evaluating, RL-based spectrum management approach for cognitive ad-hoc networks. We investigate a means to detect environmental changes by having a CR inspect its information consistency and respond accordingly to changes in the environment. We also aim to grant CRs more flexibility in exploration behavior since using this approach will make it easier to remedy any shortcomings caused by aggressive exploration. The benefit of applying our algorithm is demonstrated and comparisons of performances using evaluations of different scopes are also provided to illustrate their impact on the spectrum management. Simulation results show the proposed approach is effective and able to improve the performance by increasing CRs' responsiveness to environmental changes and allowing fast recovery.
Citation:
E. Eylem Ozekin, F. Cihan Demirci, Fatih Alagoz, "Self-evaluating reinforcement learning based spectrum management for cognitive Ad Hoc networks," icoin, pp.444-449, 2013 International Conference on Information Networking (ICOIN), 2013
Usage of this product signifies your acceptance of the Terms of Use.