This Article 
 Bibliographic References 
 Add to: 
Coordinating Power Control and Performance Management for Virtualized Server Clusters
February 2011 (vol. 22 no. 2)
pp. 245-259
Xiaorui Wang, University of Tennessee, Knoxville
Yefu Wang, University of Tennessee, Knoxville
Today's data centers face two critical challenges. First, various customers need to be assured by meeting their required service-level agreements such as response time and throughput. Second, server power consumption must be controlled in order to avoid failures caused by power capacity overload or system overheating due to increasing high server density. However, existing work controls power and application-level performance separately, and thus, cannot simultaneously provide explicit guarantees on both. In addition, as power and performance control strategies may come from different hardware/software vendors and coexist at different layers, it is more feasible to coordinate various strategies to achieve the desired control objectives than relying on a single centralized control strategy. This paper proposes Co-Con, a novel cluster-level control architecture that coordinates individual power and performance control loops for virtualized server clusters. To emulate the current practice in data centers, the power control loop changes hardware power states with no regard to the application-level performance. The performance control loop is then designed for each virtual machine to achieve the desired performance even when the system model varies significantly due to the impact of power control. Co-Con configures the two control loops rigorously, based on feedback control theory, for theoretically guaranteed control accuracy and system stability. Empirical results on a physical testbed demonstrate that Co-Con can simultaneously provide effective control on both application-level performance and underlying power consumption.

[1] X. Wang and Y. Wang, "Co-Con: Coordinated Control of Power and Application Performance for Virtualized Server Clusters," Proc. 17th IEEE Int'l Workshop Quality of Service (IWQoS), 2009.
[2] X. Fan, W.-D. Weber, and L.A. Barroso, "Power Provisioning for a Warehouse-Sized Computer," Proc. Int'l Symp. Computer Architecture (ISCA), 2007.
[3] C. Lefurgy, X. Wang, and M. Ware, "Power Capping: A Prelude to Power Shifting," Cluster Computing, vol. 11, no. 2, pp. 183-195, 2008.
[4] United States Environmental Protection Agency, "Report to Congress on Server and Data Center Energy Efficiency," 2007.
[5] J.S. Chase, D.C. Anderson, P.N. Thakar, A.M. Vahdat, and R.P. Doyle, "Managing Energy and Server Resources in Hosting Centers," Proc. Symp. Operating System Principles (SOSP), 2001.
[6] Y. Chen, A. Das, W. Qin, A. Sivasubramaniam, Q. Wang, and N. Gautam, "Managing Server Energy and Operational Costs in Hosting Centers," Proc. ACM SIGMETRICS, 2005.
[7] M. Elnozahy, M. Kistler, and R. Rajamony, "Energy-Efficient Server Clusters," Proc. Second Workshop Power-Aware Computing Systems, 2002.
[8] V. Sharma, A. Thomas, T. Abdelzaher, K. Skadron, and Z. Lu, "Power-Aware QoS Management in Web Servers," Proc. Int'l Real-Time Systems Symp. (RTSS), 2003.
[9] Y. Wang, X. Wang, M. Chen, and X. Zhu, "Power-Efficient Response Time Guarantees for Virtualized Enterprise Servers," Proc. Int'l Real-Time Systems Symp. (RTSS), 2008.
[10] R.J. Minerick, V.W. Freeh, and P.M. Kogge, "Dynamic Power Management Using Feedback," Proc. Workshop Compilers and Operating Systems for Low Power, Sept. 2002.
[11] X. Wang and M. Chen, "Cluster-Level Feedback Power Control for Performance Optimization," Proc. Int'l Symp. High-Performance Computer Architecture (HPCA), 2008.
[12] Q. Wu, P. Juang, M. Martonosi, L.-S. Peh, and D.W. Clark, "Formal Control Techniques for Power-Performance Management," IEEE Micro, vol. 25, no. 5, pp. 52-62, Sept./Oct. 2005.
[13] J.O. Kephart, H. Chan, R. Das, D.W. Levine, G. Tesauro, F. Rawson, and C. Lefurgy, "Coordinating Multiple Autonomic Managers to Achieve Specified Power-Performance Tradeoffs," Proc. Int'l Conf. Autonomic Computing (ICAC), 2007.
[14] M.E. Femal and V.W. Freeh, "Boosting Data Center Performance through Non-Uniform Power Allocation," Proc. Int'l Conf. Autonomic Computing (ICAC), 2005.
[15] P. Bohrer, E.N. Elnozahy, T. Keller, M. Kistler, C. Lefurgy, C. McDowell, and R. Rajamony, "The Case for Power Management in Web Servers," Power Aware Computing, Kluwer Academic Publishers, 2002.
[16] C. Clark, K. Fraser, S. Hand, J.G. Hansen, E. Jul, C. Limpach, I. Pratt, and A. Warfield, "Live Migration of Virtual Machines," Proc. Symp. Networked Systems Design and Implementation (NSDI), 2005.
[17] A.A. Soror, U.F. Minhas, A. Aboulnaga, K. Salem, P. Kokosielis, and S. Kamath, "Automatic Virtual Machine Configuration for Database Workloads," Proc. ACM Int'l Conf. Management of Data, 2008.
[18] X. Wang, Y. Chen, C. Lu, and X. Koutsoukos, "On Controllability and Feasibility of Utilization Control in Distributed Real-Time Systems," Proc. Euromicro Conf. Real-Time Systems (ECRTS), 2007.
[19] "Credit Scheduler," CreditScheduler , 2010.
[20] J.L. Hellerstein, Y. Diao, S. Parekh, and D.M. Tilbury, Feedback Control of Computing Systems. John Wiley & Sons, 2004.
[21] G.F. Franklin, J.D. Powell, and M. Workman, Digital Control of Dynamic Systems, third ed. Addison-Wesley, 1997.
[22] J.M. Maciejowski, Predictive Control with Constraints. Prentice Hall, 2002.
[23] C. Lu, X. Wang, and X. Koutsoukos, "Feedback Utilization Control in Distributed Real-Time Systems with End-to-End Tasks," IEEE Trans. Parallel and Distributed Systems, vol. 16, no. 6, pp. 550-561, June 2005.
[24] K. Skadron, T. Abdelzaher, and M.R. Stan, "Control-Theoretic Techniques and Thermal-RC Modeling for Accurate and Localized Dynamic Thermal Management," Proc. Int'l Symp. High-Performance Computer Architecture (HPCA), 2002.
[25] B. Diniz, D. Guedes, W. Meira,Jr., and R. Bianchini, "Limiting the Power Consumption of Main Memory," Proc. Int'l Symp. Computer Architecture (ISCA), 2007.
[26] Y. Wang, K. Ma, and X. Wang, "Temperature-Constrained Power Control for Chip Multiprocessors with Online Model Estimation," Proc. Int'l Symp. Computer Architecture (ISCA), 2009.
[27] T. Horvath, T. Abdelzaher, K. Skadron, and X. Liu, "Dynamic Voltage Scaling in Multi-Tier Web Servers with End-to-End Delay Control," IEEE Trans. Computers, vol. 56, no. 4, pp. 444-458, Apr. 2007.
[28] R. Nathuji and K. Schwan, "VirtualPower: Coordinated Power Management in Virtualized Enterprise Systems," Proc. Symp. Operating System Principles (SOSP), 2007.
[29] J. Stoess, C. Lang, and F. Bellosa, "Energy Management for Hypervisor-Based Virtual Machines," Proc. USENIX Ann. Technical Conf., 2007.
[30] J. Choi, S. Govindan, B. Urgaonkar, and A. Sivasubramaniam, "Profiling, Prediction, and Capping of Power Consumption in Consolidated Environments," Proc. IEEE Int'l Symp. Modeling, Analysis and Simulation of Computers and Telecomm. Systems (MASCOTS), Sept. 2008.
[31] D. Kusic, J. Kephart, J. Hanson, N. Kandasamy, and G. Jiang, "Power and Performance Management of Virtualized Computing Environments via Lookahead Control," Proc. Int'l Conf. Autonomic Computing (ICAC), 2008.
[32] R. Raghavendra, P. Ranganathan, V. Talwar, Z. Wang, and X. Zhu, "No Power Struggles: Coordinated Multi-Level Power Management for the Data Center," Proc. Int'l Conf. Architectural Support for Programming Languages and Operating Systems (ASPLOS), 2008.
[33] T.F. Abdelzaher, J. Stankovic, C. Lu, R. Zhang, and Y. Lu, "Feedback Performance Control in Software Services," IEEE Control Systems, vol. 23, no. 3, pp. 74-90, June 2003.
[34] D.C. Steere, A. Goel, J. Gruenberg, D. McNamee, C. Pu, and J. Walpole, "A Feedback-Driven Proportion Allocator for Real-Rate Scheduling," Proc. Symp. Operating Systems Design and Implementation (OSDI), 1999.
[35] X. Wang, D. Jia, C. Lu, and X. Koutsoukos, "DEUCON: Decentralized End-to-End Utilization Control for Distributed Real-Time Systems," IEEE Trans. Parallel and Distributed Systems, vol. 18, no. 7, pp. 996-1009, July 2007.
[36] M. Karlsson, C.T. Karamanolis, and X. Zhu, "Triage: Performance Differentiation for Storage Systems Using Adaptive Control," ACM Trans. Storage, vol. 1, no. 4, pp. 457-480, 2005.
[37] S. Keshav, "A Control-Theoretic Approach to Flow Control," Proc. ACM SIGCOMM, 1991.
[38] P. Padala, K.G. Shin, X. Zhu, M. Uysal, Z. Wang, S. Singhal, A. Merchant, and K. Salem, "Adaptive Control of Virtualized Resources in Utility Computing Environments," Proc. European Conf. Computer Systems (EuroSys), 2007.

Index Terms:
Power control, power management, performance, virtualization, server clusters, data centers, control theory.
Xiaorui Wang, Yefu Wang, "Coordinating Power Control and Performance Management for Virtualized Server Clusters," IEEE Transactions on Parallel and Distributed Systems, vol. 22, no. 2, pp. 245-259, Feb. 2011, doi:10.1109/TPDS.2010.91
Usage of this product signifies your acceptance of the Terms of Use.