This Article 
 Bibliographic References 
 Add to: 
An Analytical Approach to Providing Controllable Differentiated Quality of Service in Web Servers
November 2005 (vol. 16 no. 11)
pp. 1022-1033

Abstract—Provisioning quality of service (QoS) in Web servers has gained immense importance because Web servers are a major part of the Internet. To deliver the pledged QoS, Web service providers need control over the allocation of the resources in their Web servers. Control is also necessary for reaching the optimal resource allocation through proper service differentiation. In this paper, we propose and investigate an analytic approach that enables the service providers to deploy a differentiated service policy that offers this control. The proposed service policy is configurable by tunable control parameters. We devise the relationships between the performance measures and these parameters by adopting a unique queuing theoretic approach. Once these relationships are established, we describe how these parameters can be set to their most appropriate values depending on the objectives of the service providers. We illustrate the usefulness of our approach by conducting the analysis on a real Web trace.

[1] J. Almedia, M. Dabu, A. Manikntty, and P. Cao, “Providing Differentiated Levels of Service in Web Content Hosting,” Proc. First Workshop Internet Server Performance, June 1998.
[2] L. Eggert and J. Heidemann, “Application-Level Differentiated Services for Web Servers,” World Wide J., vol. 2, no. 3, pp. 133-142, Aug. 1999.
[3] N. Bhatti and R. Friedrich, “Web Server Support for Tiered Services,” IEEE Network, vol. 13, no. 5, pp. 64-71, Sept. 1999.
[4] V. Kanodia and E. Knightly, “Ensuring Latency Targets in Multiclass Web Servers,” IEEE Trans. Parallel and Distributed Systems, vol. 14, no. 1, Jan. 2003.
[5] H. Chen and P. Mohapatra, “Session-Based Overload Control in QoS-Aware Web Servers,” Proc. IEEE INFOCOM 2002 Conf., June 2002.
[6] T. Abdelzaher, K.G. Shin, and N. Bhatti, “Performance Guarantees for Web Server End-Systems: A Control-Theoretical Approach,” IEEE Trans. Parallel and Distributed Systems, vol. 13, no. 1, Jan. 2002.
[7] S.C.M. Lee, J.C.S. Lee, and D.K.Y. Yau, “A Proportional-Delay Diffserv-Enabled Web Server: Admission Control and Dynamic Adaptation,” IEEE Trans. Parallel and Distributed Systems, vol. 15, no. 5, May 2004.
[8] M.M. Teixeira, M.J. Santana, and R.H.C. Santana, “Using Adaptive Priority Scheduling for Service Differentiation in QoS-Aware Web Servers,” Proc. IEEE Int'l Conf. Performance, Computing, and Comm., pp. 279-285, Apr. 2004.
[9] N. Ye, E. Gel, X. Li, T. Farley, and Y.-C. Lai, “Web-Server QoS Models: Applying Scheduling Rules from Production Planning,” Computers and Operations Research, vol. 32, no. 5, pp. 1147-1164, May 2005.
[10] X. Zhou, J. Wei, and C.-Z. Xu, “Modeling and Analysis of 2D Service Differentiation on E-Commerce Servers,” Proc. IEEE 24th Int'l Conf. Distributed Computing Systems (ICDCS), pp. 740-747, Mar. 2004.
[11] Y. Lu, T.F. Abdelzaher, C. Lu, L. Sha, and X. Liu, “Feedback Control with Queueing-Theoretic Prediction for Relative Delay Guarantees in Web Servers,” Proc. Ninth IEEE Real-Time and Embedded Technology and Applications Symp., pp. 208-217, May 2003.
[12] X. Zhou, Y. Cai, G.K. Godavari, and C.E. Chow, “An Adaptive Process Allocation Strategy for Proportional Responsiveness Differentiation on Web Servers,” Proc. IEEE Int'l Conf. Web Services, pp. 142-149, July 2004.
[13] L. Golubchik and J.C. S. Lui, “A Fast and Accurate Iterative Solution of a Multiclass Threshold-Based Queueing System with Hysteresis,” ACM SIGMETRICS Performance Evaluation Rev., vol. 28, no. 1, pp. 196-206, 2000.
[14] B. Haverkort, H.P. Idzenga, and B.G. Kim, “Performance Evaluation of ATM Cell Scheduling Policies Using Stochastic Petri Nets,” Technical Report TIOS 94-19, Univ. of Twente, Tele-Informatics and Open Systems Group, 1994.
[15] O.J. Boxma, G. Koole, and I. Mitrani, “A Two-Queue Polling Model with a Threshold Service Policy,” Proc. MASCOTS '95 Conf., pp. 84-89, Jan. 1995.
[16] D.-S. Lee and B. Sengupta, “Queueing Analysis of Threshold Based Priority Scheme for ATM Networks,” IEEE/ACM Trans. Networking, vol. 1, no. 6, pp. 709-717, 1993.
[17] O.J. Boxma and D.G. Down, “Dynamic Server Assignment in a Two-Queue Model,” European J. Operations Research, vol. 103, pp. 595-609, 1997.
[18] E. Nahum, T. Barzilai, and D. Kandlur, “Performance Issues in WWW Servers,” ACM SIGMETRICS Performance Evaluation Rev., vol. 27, no. 1, pp. 216-217, 1999.
[19] P. Barford and M. Crovella, “A Performance Evaluation of Hyper Text Transfer Protocols,” ACM SIGMETRICS Performance Evaluation Rev., vol. 27, no. 1, pp. 188-197, 1999.
[20] X. Chen, H. Chen, and P. Mohapatra, “An Admission Control Scheme for Predictable Server Response Time for Web Accesses,” Proc. 10th World Wide Web Conf., pp. 545-554, May 2001.
[21] D.-S. Lee, “A Two-Queue Model with Exhaustive and Limited Service Disciplines,” Report C & C Research Laboratories, NEC USA, 1993.
[22] A.S. Alfa, “Matrix Geometric Solution of Discrete Time MAP/PH/1 Priority Queue,” Naval Research Logistics, vol. 45, pp. 23-50, 1998.
[23] M.F. Neuts, “Probability Distributions of Phase-Type,” Liber Amicorum Professor Emeritus H. Florin, Dept. of Mathematics, Univ. of Louvain, Belgium, pp. 173-206, 1975.
[24] K.G. Murty, Operations Research: Deterministic Optimization Models. Prentice Hall, 1995.
[25] LINDO Optimization Software, http:/, June 2004.
[26] M.F. Neuts, Matrix Geometric Solutions in Stochastic Models. Baltimore, Md.: Johns Hopkins Univ. Press, 1981.
[27] EPA-HTTP— A Day of HTTP Logs from the EPA WWW Server, , June 2004.
[28] S. Asmussen, O. Nerman, and M. Olsson, “Fitting Phase-Type Distributions via the EM algorithm,” Scandinavian J. Statistics, vol. 23, pp. 419-441, 1996.
[29] C. Dovrolis, D. Stiliadis, and P. Ramanathan, “Proportional Differentiated Services: Delay Differentiation and Packet Scheduling,” Proc. ACM SIGCOMM Conf., pp. 109-119, Aug. 1999.
[30] EMpht software, asmus pspapers.html, June 2004.
[31] DataFit Curve Fitting and Data Plotting Software, http:/, June 2004.
[32] R. Bagrodia, R. Meyer, M. Takai, Y. Chen, X. Zeng, J. Martin, B. Park, and H. Song, “Parsec: A Parallel Simulation Environment for Complex Systems,” Computer, vol. 31, no. 10, pp. 77-85, Oct. 1998.

Index Terms:
Web servers, quality of service, threshold-based, multiclass, matrix-geometric method.
Mohammad M. Rashid, Attahiru Sule Alfa, Ekram Hossain, Muthucumaru Maheswaran, "An Analytical Approach to Providing Controllable Differentiated Quality of Service in Web Servers," IEEE Transactions on Parallel and Distributed Systems, vol. 16, no. 11, pp. 1022-1033, Nov. 2005, doi:10.1109/TPDS.2005.131
Usage of this product signifies your acceptance of the Terms of Use.