Efficient Server Provisioning with Control for End-to-End Response Time Guarantee on Multitier Clusters
Issue No.01 - January (2012 vol.23)
Xiaobo Zhou , Dept. of Comput. Sci., Univ. of Colorado at Colorado Springs, Colorado Springs, CO, USA
P. Lama , Dept. of Comput. Sci., Univ. of Colorado at Colorado Springs, Colorado Springs, CO, USA
DOI Bookmark: http://doi.ieeecomputersociety.org/10.1109/TPDS.2011.88
Dynamic virtual server provisioning is critical to quality-of-service assurance for multitier Internet applications. In this paper, we address three important challenging problems. First, we propose an efficient server provisioning approach on multitier clusters based on an end-to-end resource allocation optimization model. It is to minimize the number of virtual servers allocated to the system while the average end-to-end response time guarantee is satisfied. Second, we design a model-independent fuzzy controller for bounding an important performance metric, the 90th-percentile response time of requests flowing through the multitier architecture. Third, to compensate for the latency due to the dynamic addition of virtual servers, we design a self-tuning component that adaptively adjusts the output scaling factor of the fuzzy controller according to the transient behavior of the end-to-end response time. Extensive simulation results, using two representative customer behavior models in a typical three-tier web cluster, demonstrate that the provisioning approach is able to significantly reduce the number of virtual servers allocated for the performance guarantee compared to an existing representative approach. The approach integrated with the model-independent self-tuning fuzzy controller can efficiently assure the average and the 90th-percentile end-to-end response time guarantees on multitier clusters.
workstation clusters, Internet, quality of service, model-independent self-tuning fuzzy controller, end-to-end response time, multitier cluster, dynamic virtual server provisioning, quality-of-service assurance, multitier Internet application, end-to-end resource allocation optimization model, multitier architecture, output scaling factor, customer behavior, three-tier Web cluster, Servers, Time factors, Resource management, Optimization, Fuzzy control, Internet, Pragmatics, control., Autonomic resource provisioning, performance assurance, multitier Internet services
Xiaobo Zhou, P. Lama, "Efficient Server Provisioning with Control for End-to-End Response Time Guarantee on Multitier Clusters", IEEE Transactions on Parallel & Distributed Systems, vol.23, no. 1, pp. 78-86, January 2012, doi:10.1109/TPDS.2011.88