This Article 
 Bibliographic References 
 Add to: 
PARTIC: Power-Aware Response Time Control for Virtualized Web Servers
February 2011 (vol. 22 no. 2)
pp. 323-336
Yefu Wang, University of Tennessee, Knoxville
Xiaorui Wang, University of Tennessee, Knoxville
Ming Chen, University of Tennessee, Knoxville
Xiaoyun Zhu, VMware Inc., Palo Alto
Both power and performance are important concerns for enterprise data centers. While various management strategies have been developed to effectively reduce server power consumption by transitioning hardware components to lower power states, they cannot be directly applied to today's data centers that rely on virtualization technologies. Virtual machines running on the same physical server are correlated because the state transition of any hardware component will affect the application performance of all the virtual machines. As a result, reducing power solely based on the performance level of one virtual machine may cause another to violate its performance specification. This paper proposes PARTIC, a two-layer control architecture designed based on well-established control theory. The primary control loop adopts a multi-input multi-output control approach to maintain load balancing among all virtual machines so that they can have approximately the same performance level relative to their allowed peak values. The secondary performance control loop then manipulates CPU frequency for power efficiency based on the uniform performance level achieved by the primary loop. Empirical results demonstrate that PARTIC can effectively reduce server power consumption while achieving required application-level performance for virtualized enterprise servers.

[1] Y. Wang, X. Wang, M. Chen, and X. Zhu, "Power-Efficient Response Time Guarantees for Virtualized Enterprise Servers," Proc. Real-Time Systems Symp., 2008.
[2] J. Sugerman, G. Venkitachalam, and B.-H. Lim, "Virtualizing I/O Devices on VMware Workstation's Hosted Virtual Machine Monitor," Proc. USENIX Ann. Technical Conf., 2002.
[3] B. Dragovic, K. Fraser, S. Hand, T. Harris, A. Ho, I. Pratt, A. Warfield, P. Barham, and R. Neugebauer, "Xen and the Art of Virtualization," Proc. ACM Symp. Operating Systems Principles, 2003.
[4] Microsoft Corporation, "Microsoft Virtual Server 2005," virtualserver, 2010.
[5] V. Sharma, A. Thomas, T. Abdelzaher, K. Skadron, and Z. Lu, "Power-Aware QoS Management in Web Servers," Proc. IEEE Real-Time Systems Symp., 2003.
[6] Y. Chen, A. Das, W. Qin, A. Sivasubramaniam, Q. Wang, and N. Gautam, "Managing Server Energy and Operational Costs in Hosting Centers," Proc. ACM SIGMETRICS, 2005.
[7] Y. Zhu and F. Mueller, "Feedback EDF Scheduling Exploiting Dynamic Voltage Scaling," Proc. IEEE Real-Time and Embedded Technology and Applications Symp., 2004.
[8] G.F. Franklin, J.D. Powell, and M. Workman, Digital Control of Dynamic Systems, third ed. Addison-Wesley, 1997.
[9] J.L. Hellerstein, Y. Diao, S. Parekh, and D.M. Tilbury, Feedback Control of Computing Systems. John Wiley & Sons, 2004.
[10] P. Dorato, C.T. Abdallah, and V. Cerone, Linear Quadratic Control: An Introduction. Prentice Hall, 1998.
[11] S. Elnikety, E. Nahum, J. Tracey, and W. Zwaenepoel, "A Method for Transparent Admission Control and Request Scheduling in E-Commerce Web Sites," Proc. Int'l Conf. World Wide Web, 2004.
[12] Electronic Educational Devices, Inc., "Watts Up Pro Power Meter," http:/, 2010.
[13] "Credit Scheduler," CreditScheduler , 2010.
[14] C. Lefurgy, X. Wang, and M. Ware, "Server-Level Power Control," Proc. IEEE Int'l Conf. Autonomic Computing, 2007.
[15] P. Padala, K.G. Shin, X. Zhu, M. Uysal, Z. Wang, S. Singhal, A. Merchant, and K. Salem, "Adaptive Control of Virtualized Resources in Utility Computing Environments," Proc. ACM SIGOPS/EuroSys European Conf. Computer Systems, 2007.
[16] W. Xu, X. Zhu, S. Singhal, and Z. Wang, "Predictive Control for Dynamic Resource Allocation in Enterprise Data Centers," Proc. IEEE/IFIP Network Operations and Management Symp., 2006.
[17] X. Liu, X. Zhu, S. Singhal, and M. Arlitt, "Adaptive Entitlement Control of Resource Containers on Shared Servers," Proc. IFIP/IEEE Int'l Symp. Integrated Network Management, 2005.
[18] Y. Zhang, A. Bestavros, M. Guirguis, I. Matta, and R. West, "Friendly Virtual Machines: Leveraging a Feedback-Control Model for Application Adaptation," Proc. Int'l Conf. Virtual Execution Environments, 2005.
[19] Z. Wang, X. Zhu, and S. Singhal, "Utilization and SLO-Based Control for Dynamic Sizing of Resource Partitions," Proc. IFIP/IEEE Int'l Workshop Distributed Systems, 2005.
[20] J.-J. Chen, H.-R. Hsu, K.-H. Chuang, C.-L. Yang, A.-C. Pang, and T.-W. Kuo, "Multiprocessor Energy-Efficient Scheduling with Task Migration Considerations," Proc. Euromicro Conf. Real-Time Systems, 2004.
[21] T. Horvath, T. Abdelzaher, K. Skadron, and X. Liu, "Dynamic Voltage Scaling in Multi-Tier Web Servers with End-to-End Delay Control," IEEE Trans. Computers, vol. 56, no. 4, pp. 444-458, Apr. 2007.
[22] L. Bertini, J. Leite, and D. Mosse, "SISO PIDF Controller in an Energy-Efficient Multi-Tier Web Server Cluster for E-Commerce," Proc. Second IEEE Int'l Workshop Feedback Control Implementation and Design in Computing Systems and Networks, 2007.
[23] R. Nathuji and K. Schwan, "Virtualpower: Coordinated Power Management in Virtualized Enterprise Systems," Proc. ACM SIGOPS, 2007.
[24] R.J. Minerick, V.W. Freeh, and P.M. Kogge, "Dynamic Power Management Using Feedback," Proc. Workshop Compilers and Operating Systems for Low Power, Sept. 2002.
[25] K. Skadron, T. Abdelzaher, and M.R. Stan, "Control-Theoretic Techniques and Thermal-RC Modeling for Accurate and Localized Dynamic Thermal Management," Proc. Int'l Symp. High-Performance Computer Architecture, 2002.
[26] R. Raghavendra, P. Ranganathan, V. Talwar, Z. Wang, and X. Zhu, "No Power Struggles: Coordinated Multi-Level Power Management for the Data Center," Proc. Int'l Conf. Architectural Support for Programming Languages and Operating Systems, 2008.
[27] P. Ranganathan, P. Leech, D. Irwin, and J.S. Chase, "Ensemble-Level Power Management for Dense Blade Servers," Proc. Int'l Symp. Computer Architecture, 2006.
[28] X. Wang and M. Chen, "Cluster-Level Feedback Power Control for Performance Optimization," Proc. Int'l Symp. High-Performance Computer Architecture, 2008.
[29] M. Kihl, A. Robertsson, M. Andersson, and B. Wittenmark, "Control-Theoretic Analysis of Admission Control Mechanisms for Web Server Systems," World Wide Web, vol. 11, no. 1, pp. 93-116, 2008.
[30] X. Chen, P. Mohapatra, and H. Chen, "An Admission Control Scheme for Predictable Server Response Time for Web Accesses," Proc. Int'l Conf. World Wide Web, 2001.
[31] M. Kihl, A. Robertsson, and B. Wittenmark, "Analysis of Admission Control Mechanisms Using Non-Linear Control Theory," Proc. IEEE Int'l Symp. Computers and Comm., 2003.
[32] T.F. Abdelzaher, J. Stankovic, C. Lu, R. Zhang, and Y. Lu, "Feedback Performance Control in Software Services," IEEE Control Systems, vol. 23, no. 3, pp. 74-90, June 2003.
[33] L. Abeni, L. Palopoli, G. Lipari, and J. Walpole, "Analysis of a Reservation-Based Feedback Scheduler," Proc. IEEE Real-Time Systems Symp., Dec. 2002.
[34] A. Goel, J. Walpole, and M. Shor, "Real-Rate Scheduling," Proc. IEEE Real-Time and Embedded Technology and Applications Symp., 2004.
[35] A. Cervin, J. Eker, B. Bernhardsson, and K.-E. Arzen, "Feedback-Feedforward Scheduling of Control Tasks," Real-Time Systems, vol. 23, no. 1, pp. 25-53, July 2002.
[36] M. Amirijoo, N. Chaufette, J. Hansson, S.H. Son, and S. Gunnarsson, "Generalized Performance Management of Multi-Class Real-Time Imprecise Data Services," Proc. IEEE Int'l Real-Time Systems Symp., 2005.
[37] Y. Lu, T.F. Abdelzaher, and A. Saxena, "Design, Implementation, and Evaluation of Differentiated Caching Services," IEEE Trans. Parallel and Distributed Systems, vol. 15, no. 5, pp. 440-452, May 2004.
[38] Y. Diao, N. Gandhi, J.L. Hellerstein, S. Parekh, and D.M. Tilbury, "Using MIMO Feedback Control to Enforce Policies for Interrelated Metrics with Application to the Apache Web Server," Proc. Network Operations and Management Symp., 2002.
[39] Y. Diao, J.L. Hellerstein, A.J. Storm, M. Surendra, S. Lightstone, S.S. Parekh, and C. Garcia-Arellano, "Incorporating Cost of Control into the Design of a Load Balancing Controller," Proc. IEEE Real-Time and Embedded Technology and Applications Symp., 2004.

Index Terms:
Power management, response time, virtualization, web servers, data centers, feedback control.
Yefu Wang, Xiaorui Wang, Ming Chen, Xiaoyun Zhu, "PARTIC: Power-Aware Response Time Control for Virtualized Web Servers," IEEE Transactions on Parallel and Distributed Systems, vol. 22, no. 2, pp. 323-336, Feb. 2011, doi:10.1109/TPDS.2010.79
Usage of this product signifies your acceptance of the Terms of Use.