This Article 
 Bibliographic References 
 Add to: 
eQoS: Provisioning of Client-Perceived End-to-End QoS Guarantees in Web Servers
December 2006 (vol. 55 no. 12)
pp. 1543-1556
It is important to guarantee client-perceived end-to-end quality of service (QoS) under heavy load conditions. Existing work focuses on network transfer time or server-side request processing time. In this paper, we propose a novel framework, eQoS, to monitor and controll client-perceived response time in heavy loaded Web servers. The response time is measured with respect to Web pages that contain multiple embedded objects. Within the framework, we propose an adaptive fuzzy controller, STFC, to allocate server resources. The controller assumes no knowledge of the pageview traffic model. It deals with the effect of process delay in resource allocation by its two-level self-tuning capabilities. We also prove the stability of the STFC. We implement a prototype of eQoS in Linux and conduct comprehensive experiments across wide-range server workload conditions on PlanetLab and simulated networks. Experimental results demonstrate the effectiveness of the framework: It controls the deviation of client-perceived pageview response time to be within 20 percent of a predefined target with both synthetic and real Web traffics. We also compare the STFC with other controllers, including static fuzzy, linear proportional integral (PI), and adaptive PI controllers. Experimental results show that, although the STFC works slightly worse than the static fuzzy controller in the environment where the static fuzzy controller is best tuned, because of its self-tuning capabilities, it has better performance in all other test cases by around 25 percent on average in terms of the deviation from the target response time. In addition, due to its model independence, the STFC outperforms the linear PI and adaptive PI controllers by 50 percent and 75 percent on average, respectively.

[1] T.F. Abdelzaher, K.G. Shin, and N. Bhatti, “Performance Guarantees for Web Server End-Systems: A Control-Theoretical Approach,” IEEE Trans. Parallel and Distributed Systems, vol. 13, no. 1, pp. 80-96, Jan. 2002.
[2] J. Almeida, M. Dabu, A. Manikutty, and P. Cao, “Providing Differentiated Levels of Service in Web Content Hosting,” Proc. ACM SIGMETRICS Workshop Internet Server Performance, pp. 91-102, 1998.
[3] M. Arlitt and T. Jin, “A Workload Characterization Study of the 1998 World Cup Web Site,” IEEE Network, vol. 14, no. 3, pp. 30-37, May-June 2000.
[4] P. Barford and M. Crovella, “Generating Representative Web Workloads for Network and Server Performance Evaluation,” Proc. ACM Sigmetrics, pp. 151-160, 1998.
[5] P. Barford and M. Crovella, “Critical Path Analysis of TCP Transactions,” IEEE/ACM Trans. Networking, vol. 9, no. 3, pp. 238-248, 2001.
[6] N. Bhatti, A. Bouch, and A. Kuchinsky, “Integrating User-Perceived Quality into Web Server Design,” Proc. Int'l World Wide Web Conf., pp. 1-16, 2000.
[7] N. Bhatti and R. Friedrich, “Web Server Support for Tiered Services,” IEEE Network, vol. 13, no. 5, pp. 64-71, 1999.
[8] P. Bhoj, S. Ramanathan, and S. Singhal, “Web2K: Bringing QoS to Web Servers,” Technical Report HPL-2000-61, HP Laboratories, May 2000.
[9] S. Blake, D. Black, M. Carlson, E. Davies, Z. Wang, and W. Weiss, “An Architecture for Differentiated Services,” IETF, RFC 2475, Dec. 1998.
[10] J.M. Blanquer, A. Batchelli, K. Schauser, and R. Wolski, “Quorum: Flexible Quality of Service for Internet Services,” Proc. Symp. Networked Systems Design and Implementation, 2005.
[11] R. Braden, D. Clark, and S. Shenker, “Integrated Services in the Internet Architecture: An Overview,” RFC 1633, June 1994.
[12] X. Chen and P. Mohapatra, “Performance Evaluation of Service Differentiating Internet Servers,” IEEE Trans. Computers, vol. 51, no. 11, pp. 1368-1375, Nov. 2002.
[13] L. Cherkasova, Y. Fu, W. Tang, and A. Vahdat, “Measuring and Characterizing End-to-End Internet Service Performance,” ACM Trans. Internet Technology, vol. 3, no. 4, pp. 347-391, 2003.
[14] B.-Y. Choi, S. Moon, Z.-L. Zhang, K. Papagiannaki, and C. Diot, “Analysis of Point-to-Point Packet Delay in an Operational Network,” Proc. IEEE Infocom, 2004.
[15] Y. Diao, J.L. Hellerstein, and S. Parekh, “Using Fuzzy Control to Maximize Profits in Service Level Management,” IBM Systems J., vol. 41, no. 3, pp. 403-420, 2002.
[16] C. Dovrolis, D. Stiliadis, and P. Ramanathan, “Proportional Differentiated Services: Delay Differentiation and Packet Scheduling,” IEEE/ACM Trans. Networking, vol. 10, no. 1, pp. 12-26, 2002.
[17] L. Eggert and J. Heidemann, “Application-Level Differentiated Services for Web Servers,” World Wide Web J., vol. 2, no. 3, pp. 133-142, 1999.
[18] G.F. Franklin, J.D. Powell, and A. Emami-naeini, Feedback Control of Dynamic Systems, fourth ed. Prentice Hall, 2002.
[19] M.E. Gendy, A. Bose, S.-T. Park, and K.G. Shin, “Paving the First Mile for QoS-Dependent Applications and Appliances,” Proc. Int'l Workshop Quality of Service, pp. 245-254, 2004.
[20] D. Grossman, “New Terminology and Clarifications for Diffserv,” RFC3260, Apr. 2002.
[21] F. Hernandez-Campos, K. Jeffay, and F.D. Smith, “Tracking the Evolution of Web Traffic: 1995-2003,” Proc. Int'l Symp. Modeling, Analysis, and Simulation of Computer and Telecomm. Systems, pp. 16-25, 2003.
[22] A. Kamra, V. Misra, and E. Nahum, “Yaksha: A Self Tuning Controller for Managing the Performance of 3-Tiered Websites,” Proc. Int'l Workshop Quality of Service, pp. 47-56, 2004.
[23] M. Karlsson, C. Karamanolis, and X. Zhu, “Triage: Performance Isolation and Differentiation for Storage Systems,” Proc. Int'l Workshop Quality of Service, pp. 67-76, 2004.
[24] J. Kaur and H. Vin, “Providing Deterministic End-to-End Fairness Guarantees in Core-Stateless Networks,” Proc. Int'l Workshop Quality of Service, pp. 401-421, 2003.
[25] B. Li and K. Nahrstedt, “A Control-Based Middleware Framework for Quality of Service Adaptations,” IEEE J. Selected Areas in Comm., vol. 17, no. 9, pp. 1632-1650, Sept. 1999.
[26] X. Liu, L. Sha, Y. Diao, J.L. Hellerstein, and S. Parekh, “Online Response Time Optimization of Apache Web Server,” Proc. Int'l Workshop Quality of Service, pp. 461-478, 2003.
[27] C. Lu, T.F. Abdelzaher, J.A. Sankovic, and S.H. Son, “A Feedback Control Approach for Guaranteeing Relative Delays in Web Servers,” Proc. IEEE Real-Time and Embedded Technology and Applications Symp., 2001.
[28] Y. Lu, T.F. Abdelzaher, C. Lu, L. Sha, and X. Liu, “Feedback Control with Queueing-Theoretic Prediction for Relative Delay Guarantees in Web Servers,” Proc. IEEE Real-Time and Embedded Technology and Applications Symp., pp. 208-217, May 2003.
[29] R.K. Mudi and N.R. Pal, “A Robust Self-Tuning Scheme for PI- and PD-Type Fuzzy Controllers,” IEEE Trans. Fuzzy Systems, vol. 7, no. 1, pp. 2-16, Feb. 1999.
[30] K. Nichols, V. Jacobson, and L. Zhang, “A Two-Bit Differentiated Services Architecture for the Internet,” RFC 2638, July 1999.
[31] D.P. Olshefski, J. Nieh, and E. Nahum, “ksniffer: Determining the Remote Client Perceived Response Time from Live Packet Streams,” Proc. USENIX Operating Systems Design and Implementation, 2004.
[32] A.K. Parekh and R.G. Gallager, “A Generalized Processor Sharing Approach to Flow Control in Integrated Services Networks: The Single-Node Case,” IEEE/ACM Trans. Networking, vol. 1, no. 3, pp.344-357, 1993.
[33] K. Park, V.S. Pai, L. Peterson, and Z. Wang, “CoDNS: Improving DNS Performance and Reliability via Cooperative Lookups,” Proc. USENIX Operating Systems Design and Implementation, pp. 199-214, 2004.
[34] S. Patchararungruang, S.K. Halgamuge, and N. Shenoy, “Optimized Rule-Based Delay Proportion Adjustment for Proportional Differentiated Services,” IEEE J. Selected Areas in Comm., vol. 23, no. 2, pp. 261-276, Feb. 2005.
[35] V. Paxson and S. Floyd, “Wide Area Traffic: The Failure of Poisson Modeling,” IEEE/ACM Trans. Networking, vol. 3, no. 3, pp. 226-244, June 1995.
[36] L. Peterson, T. Anderson, D. Culler, and T. Roscoe, “A Blueprint for Introducing Disruptive Technology into the Internet,” Proc. ACM Workshop Hot Topics in Networking, 2002.
[37] P. Pradhan, R. Tewari, S. Sahu, A. Chandra, and P. Shenoy, “An Observation-Based Approach towards Self-Managing Web Servers,” Proc. Int'l Workshop Quality of Service, 2002.
[38] L. Sha, X. Liu, Y. Lu, T.F. Abdelzaher, “Queueing Model Based Network Server Performance Control,” Proc. IEEE Real-Time Systems Symp., pp. 81-90, 2002.
[39] S. Shakkottai, R. Srikant, N. Brownlee, A. Broido, and K. Claffy, “The RTT Distribution of TCP Flows in the Internet and Its Impact on TCP-Based Flow Control,” technical report, Cooperative Assoc. for Internet Data Analysis (CAIDA), 2004.
[40] F.G. Shinskey, Process Control Systems: Application, Design, and Tuning, fourth ed. McGraw-Hill, 1996.
[41] J. Slottow, A. Shahriari, M. Stein, X. Chen, C. Thomas, and P.B. Ender, “Instrumenting and Tuning Dataview—A Networked Application for Navigating through Large Scientific Datasets,” Software Practice and Experience, vol. 32, no. 2, pp. 165-190, Nov. 2002.
[42] W.R. Stevens, Advanced Programming in the UNIX Environment. Addison-Wesley, 1993.
[43] W. Sun and K.G. Shin, “Coordinated Aggregate Scheduling for Improving End-to-End Delay Performance,” Proc. Int'l Workshop Quality of Service, 2004.
[44] V. Sundaram and P. Shenoy, “A Practical Learning-Based Approach for Dynamic Storage Bandwidth Allocation,” Proc. Int'l Workshop Quality of Service, 2003.
[45] B. Urgaonkar, P. Shenoy, “Cataclysm: Handling Extreme Overloads in Internet Applications,” Proc. Int'l World Wide Web Conf., May 2005.
[46] T. Voigt, R. Tewari, D. Freimuth, and A. Mehra, “Kernel Mechanisms for Service Differentiation in Overloaded Web Servers,” Proc. USENIX Ann. Technical Conf., June 2001.
[47] J. Wei and C. Xu, “sMonitor: A Non-Intrusive Client-Perceived End-to-End Performance Monitor of Secured Internet Services,” Proc. USENIX Ann. Technical Conf., 2006.
[48] J. Wei, X. Zhou, and C.-Z. Xu, “Robust Processing Rate Allocation for Proportional Slowdown Differentiation on Internet Servers,” IEEE Trans. Computers, vol. 54, no. 8, pp. 964-977, Aug. 2005.
[49] M. Welsh and D. Culler, “Adaptive Overload Control for Busy Internet Servers,” Proc. USENIX Symp. Internet Technologies and Systems, 2003.
[50] R. Zhang, Real-Time Web Log Replayer, http://www.cs.virginia. edu/~rz5b/software software.htm, 2006.

Index Terms:
Client-perceived end-to-end, pageview response time, quality of service, self-tuning fuzzy control, Web servers.
Jianbin Wei, Cheng-Zhong Xu, "eQoS: Provisioning of Client-Perceived End-to-End QoS Guarantees in Web Servers," IEEE Transactions on Computers, vol. 55, no. 12, pp. 1543-1556, Dec. 2006, doi:10.1109/TC.2006.197
Usage of this product signifies your acceptance of the Terms of Use.