Issue No.07 - July (2012 vol.11)
pp: 1151-1162
Wen-Ching Chung , National Chiao Tung University, Hsinchu
Kai-Ten Feng , National Chiao Tung University, Hsinchu
Ying-Yu Chen , National Chiao Tung University, Hsin-Chu
In this paper, we propose a fuzzy Q-learning-based MIMO configuration mode and MCS level (FQL-MOMS) selection scheme for high speed packet access evolution ({\rm HSPA}^{+}) systems. The FQL-MOMS selection scheme intends to enhance the system throughput under the block error rate (BLER) requirement guarantee. It will determine an appropriate MIMO configuration mode and MCS (modulation and coding scheme) level for packet data transmission in {\rm HSPA}^{+} systems, under the situations that the channel status is varying and the channel quality indication (CQI) has report delay. The FQL-MOMS scheme considers not only the reported CQI and the last transmission result but also the BLER performance metric and the transmission efficiency. Moreover, it is effectively configured, where the fuzzy rules and the reinforcement signals for the Q-learning algorithm are sophisticatedly designed. Simulation results show that the proposed FQL-MOMS scheme increases the system throughput by up to 49.3 and 35.9 percent, compared to the conventional adaptive threshold selection (ATS) scheme [CHECK END OF SENTENCE] and the Q-HARQ scheme [CHECK END OF SENTENCE], respectively, under the BLER requirement fulfillment.
{\rm HSPA}^{+}, MIMO, MCS, HARQ, BLER, fuzzy logic, and Q-learning.
Wen-Ching Chung, Kai-Ten Feng, Ying-Yu Chen, "An MIMO Configuration Mode and MCS Level Selection Scheme by Fuzzy Q-Learning for HSPA⁺ Systems", IEEE Transactions on Mobile Computing, vol.11, no. 7, pp. 1151-1162, July 2012, doi:10.1109/TMC.2011.139
[1] "UMTS Physical Layer Procedures (FDD)," technical report 3GPP TR 25.214, Third Generation Partnership Project, May 2008.
[2] E. Dahlman, S. Parkvall, J. Sköld, and P. Beming, 3G Evolution: HSPA and LTE for Mobile Broadband. Elsevier, 2007.
[3] G.J. Foschini, "Layered Space-Time Architecture for Wireless Communication in Fading Environment when Using Multiple Antennas," Bell Labs Technical J., vol. 1, no. 2, pp. 41-59, 1996.
[4] V. Tarokh, H. Jafarkhani, and A.R. Calderbank, "Space-Time Block Codes from Orthogonal Designs," IEEE Trans. Information Theory, vol. 45, no. 5, pp. 1456-1467, July 1999.
[5] L. Zheng and D.N.C Tse, "Diversity and Multiplexing: A Fundamental Trade Off in Multiple-Antenna Channels," IEEE Trans. Information Theory, vol. 49, no. 5, pp. 1073-1096, May 2003.
[6] M. Wrulich, S. Eder, I. Viering, and M. Rupp, "Efficient Link-to-System Level Model for MIMO HSDPA," Proc. IEEE GlobeCom, pp. 1-6, Dec. 2008.
[7] C. Mehlführer, S. Caban, M. Wrulich, and M. Rupp, "Joint Throughput Optimized CQI and Precoding Weight Calculation for MIMO HSDPA," Proc. Signals, Systems and Computers Conf., pp. 1320-1325, Oct. 2008.
[8] J. Li and Y.Q. Zhao, "Resequencing Analysis of Stop-and-Wait ARQ for Parallel Multichannel Communications," IEEE/ACM Trans. Networking, vol. 17, no. 3, pp. 817-830, June 2009.
[9] L.C. Wang and C.W. Chang, "Gap Processing Time Analysis of Stall Avoidance Schemes for High-Speed Downlink Packet Access with Parallel HARQ Mechanism," IEEE Trans. Mobile Computing, vol. 5, no. 11, pp. 1591-1605, Nov. 2006.
[10] T. Cheng, "Coding Performance of Hybrid ARQ Schemes," IEEE Trans. Comm., vol. 54, no. 6, pp. 1017-1029, June 2006.
[11] S. Chen, J. Du, M. Peng, and W. Wang, "Performance Analysis and Improvement of HARQ Techniques in TDD-HSDPA/SA System," Proc. Sixth Int'l Conf. ITS-Telecomm., pp. 523-526, 2006.
[12] M. Nakamura, Y. Awad, and S. Vadgama, "Adaptive Control of Link Adaptation for High Speed Downlink Packet Access in WCDMA," Wireless Personal Multimedia Comm., vol. 2, pp. 382-386, 2002.
[13] A. Muller and T. Chen, "Improving HSDPA Link Adaptation by Considering the Age of Channel Quality Feedback Information," Proc. IEEE Vehicular Technology Conf., pp. 1643-1647, Sept. 2005.
[14] C.J. Chang, C.Y. Chang, and F.C. Ren, "Q-Learning-Based Hybrid ARQ for High Speed Downlink Packet Access in UMTS," Proc. IEEE Vehicular Technology Conf., pp. 2610-2615, Apr. 2007.
[15] C.J.C.H. Watkins and P. Dayan, "Technical Note: Q-Learning," Machine Learning, vol. 8, no. 3, pp. 279-292, 1992.
[16] L. Zhao, J.W. Mark, and T.C. Yoon, "A Combined Link Adaptation and Incremental Redundancy Protocol for Enhanced Data Transmission," Proc. IEEE GlobeCom, vol. 2, pp. 1277-1281, Nov. 2001.
[17] C.T. Lin and C.S.G. Lee, Neural Fuzzy Systems: A Neuro-Fuzzy Synergism to Intelligent Systems. Prentice Hall, 1996.
[18] J. Ye, X. Shen, and J.W. Mark, "Call Admission Control in Wideband CDMA Cellular Networks by Using Fuzzy Logic," IEEE Trans. Mobile Computing, vol. 4, no. 2, pp. 129-141, Mar./Apr. 2005.
[19] H.R. Berenji, "Fuzzy Q-Learning: A New Approach for Fuzzy Dynamic Programming," Proc. IEEE Int'l Conf. Fuzzy Systems, pp. 486-491, 1994.
[20] T. Horiuchi, A. Fujino, O. Katai, and T. Sawaragi, "Fuzzy Interpolation-Based Q-Learning with Profit Sharing Plan Scheme," Proc. IEEE Int'l Conf. Fuzzy Systems, pp. 1707-1712, 1997.
[21] P.Y. Glorennec and J. Jouffe, "Fuzzy Q-Learning," Proc. IEEE Int'l Conf. Fuzzy Systems, pp. 659-662, 1997.
[22] L. Jouffe, "Fuzzy Inference System Learning by Reinforcement Methods," IEEE Trans. Systems, Man, and Cybernetics, Part C: Applications and Rev., vol. 28, no. 3, pp. 338-355, Aug. 1998.
[23] C.F. Juang and C.M. Lu, "Ant Colony Optimization Incorporated with Fuzzy Q-Learning for Reinforcement Fuzzy Control," IEEE Trans. Systems, Man and Cybernetics, Part A: Systems and Humans, vol. 39, no. 3, pp. 597-608, May 2009.
[24] C.F. Juang, "Combination of Online Clustering and Q-Value Based GA for Reinforcement Fuzzy System Design," IEEE Trans. Fuzzy Systems, vol. 13, no. 3, pp. 289-302, June 2005.
[25] Y.H. Chen, C.J. Chang, and C.Y. Huang, "Fuzzy Q-Learning Admission Control for WCDMA/WLAN Heterogeneous Networks with Multimedia Traffic," IEEE Trans. Mobile Computing, vol. 8, no. 11, pp. 1469-1479, Nov. 2009.
[26] C.Y. Huang, W.C. Chung, C.J. Chang, and F.C. Ren, "Fuzzy Q-Learning-Based Hybrid ARQ for High Speed Downlink Packet Access," Proc. IEEE Vehicular Technology Conf., pp. 1-4, Sept. 2009.
[27] "Physical Layer Aspects of UTRA High Speed Downlink Packet Access (Release 4)," technical report 3GPP TR 25.848, Third Generation Partnership Project, Mar. 2001.
[28] R. Bellman, Dynamic Programming. Princeton Univ., 1957.
[29] G.L. Stuber, Principle of Mobile Communication. Kluwer Academic Publisher, 2001.
[30] M. Gudmundson, "Correlation Model for Shadow Fading in Mobile Radio Systems," IEE Electronics Letters, vol. 27, no. 23, pp. 2145-2146, Nov. 1991.