This Article 
 Bibliographic References 
 Add to: 
Request Redirection Algorithms for Distributed Web Systems
April 2003 (vol. 14 no. 4)
pp. 355-368
Valeria Cardellini, IEEE Computer Society
Michele Colajanni, IEEE Computer Society

Abstract—Replication of information among multiple servers is necessary to support high request rates to popular Web sites. We consider systems that maintain one interface to the users, even if they consist of multiple nodes with visible IP addresses that are distributed among different networks. In these systems, the first-level dispatching is achieved through the Domain Name System (DNS) during the address lookup phase. Distributed Web systems can use some request redirection mechanism as a second-level dispatching because the DNS routing scheme has limited control on offered load. Redirection is always executed by the servers, but there are many alternatives that are worth of investigation. In this paper, we explore the combination of DNS dispatching with redirection schemes that use centralized or distributed control on the basis of global or local state information. In the fully distributed schemes, DNS dispatching is carried out by simple algorithms because load sharing are taken by some redirection mechanisms that each server activates autonomously. On the other hand, in fully centralized schemes, redirection is used as a tool to enforce the decisions taken by the same centralized entity that provides the first-level dispatching. We also investigate some hybrid strategies. We conclude that the distributed algorithms are preferable over the centralized counterpart because they provide stable performance, can take content-aware dispatching decisions, can limit the percentage of redirected requests and, last, but not least, their implementation is much simpler than that required by the centralized schemes.

[1] D. Andresen, T. Yang, and O.H. Ibarra, “Towards a Scalable Distributed WWW Server on Networked Workstations,” J. Parallel and Distributed Computing, vol. 42, pp. 91-100, 1997.
[2] M. Arlitt and T. Jin, “Workload Characterization of the 1998 World Cup Web Site,” IEEE Network, vol. 14, no. 3, pp. 30-37, May 2000.
[3] L. Aversa and A. Bestavros, “Load Balancing a Cluster of Web Servers using Distributed Packet Rewriting,” Proc. 19th IEEE Int'l Performance, Computing, and Comm. Conf. (IPCCC), pp. 24-29, Feb. 2000.
[4] P. Barford and M.E. Crovella, “A Performance Evaluation of Hyper Text Transfer Protocols,” Proc. ACM Sigmetrics 1999, pp. 188-197, May 1999.
[5] P. Barford and M.E. Crovella, “Critical Path Analysis of TCP Transactions,” IEEE/ACM Trans. Networking, vol. 9, no. 3, pp. 238-248, June 2001.
[6] V. Cardellini, E. Casalicchio, M. Colajanni, and P.S. Yu, “The State of the Art in Locally Distributed Web-Server Systems,” ACM Computing Surveys, vol. 34, no. 2, pp. 263-311, June 2002.
[7] V. Cardellini, M. Colajanni, and P.S. Yu, Geographic Load Balancing for Scalable Distributed Web Systems Proc. Eighth IEEE/ACM Int'l Symp. Modeling, Analysis and Simulation of Computer and Telecommunication Systems, pp. 20-27, Aug. 2000.
[8] M. Colajanni and P.S. Yu, “A Performance Study of Robust Load Sharing Strategies for Distributed Heterogeneous Web Server Systems,” IEEE Trans. Knowledge and Data Eng., vol. 14, no. 2, pp. 398-414, Mar./Apr. 2002.
[9] M. Dahlin, “Interpreting Stale Load Information,” IEEE Trans. Parallel and Distributed Systems, vol. 11, no. 10, pp. 1033-1047, Oct. 2000.
[10] D.L. Eager, E.D. Lazowska, and J. Zahorjan, "Adaptive Load Sharing in Homogeneous Distributed Systems," IEEE Trans. Software Eng., vol. 12, no. 5, pp. 662-675, May 1986.
[11] R.T. Fielding, J. Gettys, J.C. Mogul, H.F. Frystyk, L. Masinter, P.J. Leach, and T. Berners-Lee, “Hypertext Transfer Protocol—HTTP/1.1,” RFC 2616, June 1999.
[12] S. Floyd and V. Paxson, "Difficulties in Simulating the Internet," IEEE/ACM Trans. Networking, vol. 9, no. 4, Aug. 2001, pp. 392–403; .
[13] J. Heidemann, K. Obracza, and J. Touch, Modeling the Performance of HTTP over Several Transport Protocols IEEE/ACM Trans. Networking, pp. 616-631, Oct. 1997.
[14] J. Kangasharju, K.W. Ross, and J.W. Roberts, “Performance Evaluation of Redirection Schemes in Content Distribution Networks,” Computer Comm., vol. 24, nos. 1-2, pp. 207-214, Feb. 2001.
[15] D. Karger, A. Sherman, A. Berkheimer, B. Bogstad, R. Dhanidina, K. Iwamoto, B. Kim, L. Matkins, and Y. Yerushalmi, “Web Caching with Consistent Hashing,” Computer Networks, vol. 31, nos. 11-16, pp. 1203-1213, Feb. 1999.
[16] O. Kremien and J. Kramer, "Methodical Analysis of Adaptive Load Sharing Algorithms," IEEE Trans. Parallel and Distributed Systems, vol. 3, no. 11, pp. 747-760, Nov. 1992.
[17] B. Krishnamurthy and J. Wang, “On Network-Aware Clustering of Web Clients,” Proc. SIGCOMM Conf., pp. 97-110, Aug. 2000.
[18] T. Kunz, “The Influence of Different Workload Descriptions on a Heuristic Load Balancing Scheme,” IEEE Trans. Software Engineering, vol. 17, no. 7, pp. 725-730, July 1991.
[19] Q. Li and B. Moon, “Distributed Cooperative Apache Web Server,” Proc. 10th Int'l World Wide Web Conf., pp. 555-564, May 2001.
[20] H. Schwetman, “CSIM18—The Simulation Engine,” Mesquite Software, 2002.
[21] A. Shaikh, R. Tewari, and M. Agrawal, On the Effectveness of DNS-Based Server Selection Proc. IEEE Infocom, Apr. 2001.
[22] N.G. Shivaratri, P. Krueger, and M. Singhal, “Load Distributing for Locally Distributed Systems,” Computer, vol. 25, no. 12, pp. 33-44, Dec. 1992.
[23] M. Rabinovich and O. Spatscheck, Web Caching and Replication, Addison-Wesley, 2002.
[24] E.L. Lawler, J.K. Lenstra, A.H.G. Rinnooy Kan, and D.B. Shymoys, “Sequencing and Scheduling: Algorithms and Complexity,” Handbooks in Operations Research and Management Science: Logistic of Production and Inventory, Elsevier Science, vol. 4, pp. 445-522, 1993.

Index Terms:
World Wide Web, load balancing, distributed systems, dispatching algorithms, performance analysis.
Valeria Cardellini, Michele Colajanni, Philip S. Yu, "Request Redirection Algorithms for Distributed Web Systems," IEEE Transactions on Parallel and Distributed Systems, vol. 14, no. 4, pp. 355-368, April 2003, doi:10.1109/TPDS.2003.1195408
Usage of this product signifies your acceptance of the Terms of Use.