This Article 
 Bibliographic References 
 Add to: 
Experience with CONSER: A System for Server Control through Fluid Modeling
July 2011 (vol. 60 no. 7)
pp. 951-963
Luc Malrait, INRIA - Gipsa Lab, Grenoble
Sara Bouchenak, INRIA - Grenoble Universities, Grenoble
Nicolas Marchand, CNRS - Gipsa Lab, Grenoble
Server technology provides a means to support a wide range of online services and applications. However, their ad hoc configuration poses significant challenges to the performance, availability, and economical costs of applications. In this paper, we examine the impact of server configuration on the central trade-off between service performance and availability. First, we present a server model as a nonlinear continuous-time model using fluid approximations. Second, we develop concurrency control on server systems for an optimal configuration. We primarily provide two control laws for two different QoS objectives. AM\hbox{-}{\cal C} is an availability-maximizing server control that achieves the highest service availability given a fixed performance constraint; and PM\hbox{-}{\cal C} is a performance-maximizing control law that meets a desired availability target with the highest performance. We then improve the control with two additional multilevel laws. AA\hbox{-}PM\hbox{-}{\cal C} is an availability-aware performance-maximizing control, and PA\hbox{-}AM\hbox{-}{\cal C} is a performance-aware availability-maximizing control. In this paper, we present ConSer, a novel system for the control of servers. We evaluate ConSer's fluid model and control techniques on the TPC-C industry-standard benchmark. Our experiments show that the proposed techniques successfully guarantee performance and availability constraints.

[1], http:/, 2007.
[2] Apple Inc. "QuickTime Streaming Server," com/quicktimestreamingserver /, 2007.
[3] Inc., http:/, 2007.
[4] PostgreSQL, http:/, 2008.
[5] M. Arlitt and C.L. Williamson, "Web Server Workload Characterization: The Search for Invariants," ACM SIGMETRICS Performance Evaluation Rev., vol. 24, no. 1, pp. 126-137, 1996.
[6] J.A. Dilley, "Web Server Workload Characterization," Technical Report HPL-96-160, HP Laboratories, Dec. 1996.
[7] M. Arlitt and T. Jin, "Workload Characterization of the 1998 World Cup Web Site," Technical Report HPL-1999-35(R.1), HP Laboratories, Sept. 1999.
[8] Iron Mountain, "The Business Case for Disaster Recovery Planning: Calculating the Cost of Downtime," http://www. ironmountain. com/dataprotection/ resources CostOfDowntimeIrnMtn.pdf , 2001.
[9] North Am. Systems Int'l Inc., "The True Cost of Downtime," http://www.nasi.comdowntime_cost.php, 2008.
[10] J. Hyman, A.A. Lazar, and G. Pacifici, "Joint Scheduling and Admission Control for ATS-Based Switching Nodes," Proc. ACM SIGCOMM, Aug. 1992.
[11] M. Brown, "Optimizing Apache Server Performance," 3436911, Feb. 2008.
[12] Microsoft, "Optimizing Database Performance," http://msdn. aa273605(SQL.80).aspx, 2010.
[13] D.A. Menascé, D. Barbara, and R. Dodge, "Preserving QoS of E-Commerce Sites through Self-Tuning: A Performance Model Approach," Proc. ACM Conf. Electronic Commerce, Oct. 2001.
[14] S. Parekh, N. Gandhi, J. Hellerstein, D. Tilbury, T. Jayram, and J. Bigus, "Using Control Theory to Achieve Service Level Objectives in Performance Management," Real-Time Systems, vol. 23, nos. 1-2, pp. 127-141, 2002.
[15] Y. Diao, N. Gandhi, J. Hellerstein, S. Parekh, and D. Tilbury, "Using MIMO Feedback Control to Enforce Policies for Interrelated Metrics with Application to the Apache Web Server," Proc. IEEE/IFIP Network Operations and Management Symp., 2002.
[16] D. Tipper and M. Sundareshan, "Numerical Methods for Modeling Computer Networks under Nonstationary Conditions," IEEE J. Selected Areas in Comm., vol. 8, no. 9, pp. 1682-1695, Dec. 1990.
[17] W.-P. Wang, D. Tipper, and S. Banerjee, "A Simple Approximation for Modeling Nonstationary Queues," Proc. IEEE INFOCOM, Mar. 1996.
[18] A. Robertsson, B. Wittenmark, M. Kihl, and M. Andersson, "Admission Control for Web Server Systems—Design and Experimental Evaluation," Proc. 43rd IEEE Conf. Decision and Control, Dec. 2004.
[19] J. Guitart, J. Torres, and E. Ayguadé, "A Survey on Performance Management for Internet Applications," Concurrency and Computation : Practice and Experience, vol. 22, no. 1, pp. 68-106, 2010.
[20] J. Lee and R. Ben-Natan, Integrating Service Level Agreements. Wiley, 2002.
[21] T. Abdelzaher, Y. Lu, R. Zhang, and D. Henriksson, "Practical Application of Control Theory to Web Services," Proc. Am. Control Conf., June 2004.
[22] J.D.C. Little, "A Proof for the Queuing Formula L $=\lambda$ W," Operations Research, vol. 9, pp. 383-387, 1961.
[23] TPC-C, "TPC Transaction Processing Performance Council," http://www.tpc.orgtpcc/, 2008.
[24] R.E. Kalman, "A New Approach to Linear Filtering and Prediction Problems," Trans. ASME—J. Basic Eng., vol. 82, no. 1, pp. 35-45, 1960.
[25] H. Khalil, Nonlinear Systems. Prentice Hall, 2002.
[26] L. Malrait, S. Bouchenak, and N. Marchand, "Fluid Modeling and Control for Server System Performance and Availability," Proc. 39th Ann. IEEE Int'l Conf. Dependable Systems and Networks (DSN '09), June 2009.
[27] C. Loosley, F. Douglas, and A. Mimo, High-Performance Client/Server. John Wiley & Sons, Nov. 1997.
[28] E. Marcus and H. Stern, Blueprints for High Availability. Wiley, Sept. 2003.
[29] L. Cherkasova and P. Phaal, "Session-Based Admission Control: A Mechanism For Peak Load Management of Commercial Web Sites," IEEE Trans. Computers, vol. 51, no. 6, pp. 669-685, June 2002.
[30] T.F. Abdelzaher and N. Bhatti, "Web Content Adaptation to Improve Server Overload Behavior," Computer Networks, vol. 31, nos. 11-16, pp. 1563-1577, 1999.
[31] T.F. Abdelzaher, K.G. Shin, and N. Bhatti, "Performance Guarantees for Web Server End-Systems: A Control-Theoretical Approach," IEEE Trans. Parallel and Distributed Systems, vol. 13, no. 1, pp. 80-96, Jan. 2002.
[32] S. Elnikety, E. Nahum, J. Tracey, and W. Zwaenepoel, "A Method for Transparent Admission Control and Request Scheduling in E-Commerce Web Sites," Proc. 13th Int'l Conf. World Wide Web, May 2004.
[33] B. Schroeder, M. Harchol-Balter, A. Iyengar, E. Nahum, and A. Wierman, "How to Determine a Good Multi-Programming Level for External Scheduling," Proc. 22nd Int'l Conf. Data Eng., Apr. 2006.
[34] H.-U. Heiss and R. Wagner, "Adaptive Load Control in Transaction Processing Systems," Proc. 17th Int'l Conf. Very Large Data Bases, 1991.
[35] M. Kihl, A. Robertsson, and B. Wittenmark, "Analysis of Admission Control Mechanisms Using Non-Linear Control Theory," Proc. Eighth IEEE Int'l Symp. Computers and Comm., pp. 1306-1311, vol. 2, July 2003.
[36] M. Kihl, "Performance Modelling and Control of Server Systems Using Non-Linear Control Theory," Proc. 18th Int'l Teletraffic Congress, Sept. 2003.
[37] A. Kamra, "Yaksha: A Self-Tuning Controller for Managing the Performance of 3-Tiered Web Sites," Proc. Int'l Workshop Quality of Service (IWQoS), pp. 47-56, 2004.
[38] X. Liu, J. Heo, and L. Sha, "Adaptive Control of Multi-Tiered Web Application Using Queueing Predictor," Proc. 10th IEEE/IFIP Network Operations and Management Symp. (NOMS '06), 2006.
[39] X. Zhu, Z. Wang, S. Singhal, M. Uysal, A. Merchant, P. Padala, and K. Shin, "What Does Control Theory Bring to Systems Research?" ACM SIGOPS Operating Systems Rev., vol. 43, no. 1, pp. 62-69, Jan. 2009.

Index Terms:
Server systems, QoS, SLA, performance, availability, modeling, control.
Luc Malrait, Sara Bouchenak, Nicolas Marchand, "Experience with CONSER: A System for Server Control through Fluid Modeling," IEEE Transactions on Computers, vol. 60, no. 7, pp. 951-963, July 2011, doi:10.1109/TC.2010.164
Usage of this product signifies your acceptance of the Terms of Use.