International Conference on Pervasive Services (2005)
July 11, 2005 to July 14, 2005
Z. Liu , Moncton Univ., NB, Canada
J. Almhana , Moncton Univ., NB, Canada
V. Choulakian , Moncton Univ., NB, Canada
The challenges of providing data services over wireless networks come from, their high reliability requirement under noisy wireless channels. In this paper, we model the noisy channel by a continuous-time Markov process and propose a dynamical packet transmission strategy for data service. The transmission strategy optimization is formulated as a Markov decision process. We establish that the optimal strategy has a threshold structure and develop a single sample path-based optimization algorithm to tune the thresholds. Since only a single sample path is involved, the proposed algorithm can be implemented online.
single sample path-based optimization algorithm, online optimal data transmission strategy, data service, wireless network, noisy wireless channel, continuous-time Markov decision process, dynamical packet transmission strategy
J. Almhana, Z. Liu, V. Choulakian and R. McGorman, "Online optimal data transmission strategy under Markov channel," International Conference on Pervasive Services(PERSER), Santorini, Greece, 2005, pp. 429-432.