• Publication
  • 2013
  • Issue No. 9 - Sept.
  • Abstract - On the MDP-Based Cost Minimization for Video-on-Demand Services in a Heterogeneous Wireless Network with Multihomed Terminals
 This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
On the MDP-Based Cost Minimization for Video-on-Demand Services in a Heterogeneous Wireless Network with Multihomed Terminals
Sept. 2013 (vol. 12 no. 9)
pp. 1737-1749
Jongwook Lee, Samsung Advanced Institute of Technology, Yongin
Saewoong Bahk, Seoul National University, Seoul
In this paper, we deal with a cost minimization problem for a multihomed mobile terminal that downloads and plays a video-on-demand (VoD) stream. The cost consists of the user's dissatisfaction due to playback disruptions and communication cost for downloading the VoD stream. There are three components in our approach: parameter estimation, threshold adjustment, and threshold compensation. Since we do not assume any a priori knowledge about underlying random variables, necessary parameter values are estimated online. Using the resultant estimates, we formulate the problem as a Markov decision process (MDP) problem considering as if the random variables are exponentially distributed. To solve the MDP problem efficiently, we propose a threshold adjustment algorithm that exploits some structural properties of any optimal solution that are specific to our problem. Finally, to handle the cases where the random variables are not exponentially distributed, we propose a threshold compensation algorithm to compensate for the modeling error. Through extensive simulations, we compare the performance of our scheme with those of static threshold schemes.
Index Terms:
Random variables,Mobile computing,Markov processes,Minimization,Wireless networks,Mobile communication,Servers,Markov decision process,Multihoming,video-on-demand
Citation:
Jongwook Lee, Saewoong Bahk, "On the MDP-Based Cost Minimization for Video-on-Demand Services in a Heterogeneous Wireless Network with Multihomed Terminals," IEEE Transactions on Mobile Computing, vol. 12, no. 9, pp. 1737-1749, Sept. 2013, doi:10.1109/TMC.2012.139
Usage of this product signifies your acceptance of the Terms of Use.