This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Coordinated Self-Configuration of Virtual Machines and Appliances Using a Model-Free Learning Approach
April 2013 (vol. 24 no. 4)
pp. 681-690
Xiangping Bu, Dept. of Electr. & Comput. Eng., Wayne State Univ., Detroit, MI, USA
Jia Rao, Dept. of Electr. & Comput. Eng., Wayne State Univ., Detroit, MI, USA
Cheng-Zhong Xu, Dept. of Electr. & Comput. Eng., Wayne State Univ., Detroit, MI, USA
Cloud computing has a key requirement for resource configuration in a real-time manner. In such virtualized environments, both virtual machines (VMs) and hosted applications need to be configured on-the-fly to adapt to system dynamics. The interplay between the layers of VMs and applications further complicates the problem of cloud configuration. Independent tuning of each aspect may not lead to optimal system wide performance. In this paper, we propose a framework, namely CoTuner, for coordinated configuration of VMs and resident applications. At the heart of the framework is a model-free hybrid reinforcement learning (RL) approach, which combines the advantages of Simplex method and RL method and is further enhanced by the use of system knowledge guided exploration policies. Experimental results on Xen-based virtualized environments with TPC-W and TPC-C benchmarks demonstrate that CoTuner is able to drive a virtual server cluster into an optimal or near-optimal configuration state on the fly, in response to the change of workload. It improves the systems throughput by more than 30 percent over independent tuning strategies. In comparison with the coordinated tuning strategies based on basic RL or Simplex algorithm, the hybrid RL algorithm gains 25 to 40 percent throughput improvement.
Index Terms:
virtualisation,cloud computing,learning (artificial intelligence),real-time systems,resource allocation,virtual machines,coordinated tuning strategies,coordinated self-configuration,virtual machines,cloud computing,real-time resource configuration,VM,system dynamics,cloud configuration,CoTuner framework,model-free hybrid reinforcement learning,model-free hybrid RL approach,Simplex method,RL method,system knowledge,Xen-based virtualized environments,TPC-W benchmarks,TPC-C benchmarks,virtual server cluster,near-optimal configuration state,system throughput improvement,Servers,Tuning,System performance,Throughput,Resource management,Clustering algorithms,Learning,autonomic configuration,Cloud computing,reinforcement learning
Citation:
Xiangping Bu, Jia Rao, Cheng-Zhong Xu, "Coordinated Self-Configuration of Virtual Machines and Appliances Using a Model-Free Learning Approach," IEEE Transactions on Parallel and Distributed Systems, vol. 24, no. 4, pp. 681-690, April 2013, doi:10.1109/TPDS.2012.174
Usage of this product signifies your acceptance of the Terms of Use.