The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.09 - Sept. (2013 vol.12)
pp: 1788-1800
Xu Chen , The Chinese University of Hong Kong, Hong Kong
Jianwei Huang , The Chinese University of Hong Kong, Hong Kong
Husheng Li , The University of Tennessee Knoxville, Knoxville
ABSTRACT
We propose a dynamic spectrum access scheme where secondary users cooperatively recommend "goodâ channels to each other and access accordingly. We formulate the problem as an average reward-based Markov decision process. We show the existence of the optimal stationary spectrum access policy and explore its structure properties in two asymptotic cases. Since the action space of the Markov decision process is continuous, it is difficult to find the optimal policy by simply discretizing the action space and use the policy iteration, value iteration, or Q-learning methods. Instead, we propose a new algorithm based on the model reference adaptive search method and prove its convergence to the optimal policy. Numerical results show that the proposed algorithms achieve up to 18 and 100 percent performance improvement than the static channel recommendation scheme in homogeneous and heterogeneous channel environments, respectively, and is more robust to channel dynamics.
INDEX TERMS
Markov processes, Throughput, Adaptation models, Mobile computing, Adaptive systems, Cognitive radio, Correlation, model reference adaptive search, Cognitive radio, dynamic spectrum access, recommendation system
CITATION
Xu Chen, Jianwei Huang, Husheng Li, "Adaptive Channel Recommendation for Opportunistic Spectrum Access", IEEE Transactions on Mobile Computing, vol.12, no. 9, pp. 1788-1800, Sept. 2013, doi:10.1109/TMC.2012.145
REFERENCES
[1] J. Mitola, "Cognitive Radio: An Integrated Agent Architecture for Software Defined Radio," PhD dissertation, Royal Inst. of Technology (KTH), 2000.
[2] Q. Zhao, L. Tong, A. Swami, and Y. Chen, "Decentralized Cognitive MAC for Opportunistic Spectrum Access in Ad Hoc Networks: A POMDP Framework," IEEE J. Selected Areas in Comm., vol. 25, no. 3, pp. 589-600, Apr. 2007.
[3] M. Wellens, J. Riihijarvi, and P. Mahonen, "Empirical Time and Frequency Domain Models of Spectrum Use," Elsevier Physical Comm., vol. 2, pp. 10-32, 2009.
[4] M. Wellens, J. Riihijarvi, M. Gordziel, and P. Mahonen, "Spatial Statistics of Spectrum Usage: From Measurements to Spectrum Models," Proc. IEEE Int'l Conf. Comm., 2009.
[5] H. Li, "Customer Reviews in Spectrum: Recommendation System in Cognitive Radio Networks," Proc. IEEE Symp. New Frontiers in Dynamic Spectrum Access Networks (DySPAN), 2010.
[6] R. Murty, R. Chandra, T. Moscibroda, and P. Bahl, "Senseless: A Database-Driven White Spaces Network," Proc. IEEE Symp. New Frontiers in Dynamic Spectrum Access Networks (DySPAN), pp. 10-21, 2011.
[7] J. Hu, M. Fu, and S. Marcus, "A Model Reference Adaptive Search Algorithm for Global Optimization," Operations Research, vol. 55, pp. 549-568, 2007.
[8] X. Chen, J. Huang, and H. Li, "Adaptive Channel Recommendation for Opportunistic Spectrum Access," technical report, Dept. of Information Eng., The Chinese Univ. of Hong Kong, http://arxiv.org/abs1102.4728, 2012.
[9] C. Cormio, Kaushik, and R. Chowdhury, "Common Control Channel Design for Cognitive Radio Wireless Ad Hoc Networks Using Adaptive Frequency Hopping," Elsevier J. Ad Hoc Networks, vol. 8, pp. 430-438, 2010.
[10] S.M. Ross, Introduction to Stochastic Dynamic Programming. Academic, 1993.
[11] E. Gilbert et al., "Capacity of a Burst-Noise Channel," Bell System Technical J., vol. 39, no. 9, pp. 1253-1265, 1960.
[12] J. Hu, M. Fu, and S. Marcus, "A Model Reference Adaptive Search Method for Stochastic Global Optimization," Comm. Information and Systems, vol. 8, no. 3, pp. 245-276, 2008.
[13] D. Xu, E. Jung, and X. Liu, "Optimal Bandwidth Selection in Multi-Channel Cognitive Radio Networks: How Much Is too Much?" Proc. Third IEEE Symp. New Frontiers in Dynamic Spectrum Access Networks (DySPAN), 2008.
[14] S. Jones, E. Jung, X. Liu, N. Merheb, and I. Wang, "Characterization of Spectrum Activities in the U.S. Public Safety Band for Opportunistic Spectrum Access," IEEE Int'l Symp. New Frontiers in Dynamic Spectrum Access Networks (DySPAN), 2007.
[15] H. Liu, B. Krishnamachari, and Q. Zhao, "Cooperation and Learning in Multiuser Opportunistic Spectrum Access," Proc. IEEE Int'l Conf. Comm. (ICC), pp. 487-492, 2008.
[16] L. Lai, H.E. Gamal, H. Jiang, and H. Poor, "Cognitive Medium Access: Exploration, Exploitation, and Competition," IEEE Trans. Mobile Computing, vol. 10, no. 2, pp. 239-253, Feb. 2011.
[17] S. Mishra, A. Sahai, and R. Brodersen, "Cooperative Sensing among Cognitive Radios," Proc. IEEE Int'l Conf. Comm., vol. 4, pp. 1658-1663, 2006.
[18] J. Huang, R. Berry, and M.L. Honig, "Auction-Based Spectrum Sharing," ACM/Springer Mobile Networks and Applications J., vol. 11, pp. 405-418, 2006.
[19] X. Chen and J. Huang, "Spatial Spectrum Access Game: Nash Equilibria and Distributed Learning," Proc. ACM MobiHoc, June 2012.
[20] H. Li and Z. Han, "Competitive Spectrum Access in Cognitive Radio Networks: Graphical Game and Learning," Proc. IEEE Wireless Comm. and Networking Conf. (WCNC), 2010.
[21] Z. Han, C. Pandana, and K.J.R. Liu, "Distributive Opportunistic Spectrum Access for Cognitive Radio Using Correlated Equilibrium and No-Regret Learning," Proc. IEEE Wireless Comm. and Networking Conf. (WCNC), 2007.
[22] A. Anandkumar, N. Michael, and A. Tang, "Opportunistic Spectrum Access with Multiple Users: Learning Under Competition," Proc. IEEE INFOCOM, 2010.
[23] J. Zhao, H. Zheng, and G. Yang, "Distributed Coordination in Dynamic Spectrum Allocation Networks," Proc. IEEE Symp. New Frontiers in Dynamic Spectrum Access Networks (DySPAN), 2005.
[24] T. Shu and M. Krunz, "Coordinated Channel Access in Cognitive Radio Networks: A Multi-Level Spectrum Opportunity Perspective," Proc. IEEE INFOCOM, 2009.
[25] D. Goldberg, D. Nichols, B.M. Oki, and D. Terry, "Using Collaborative Filtering to Weave an Information Tapestry," Comm. ACM, vol. 35, pp. 61-70, 1992.
[26] B. Awerbuch and R. Kleinberg, "Competitive Collaborative Learning," J. Computer and System Sciences, vol. 74, pp. 1271-1288, 2008.
721 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool