This Article 
 Bibliographic References 
 Add to: 
A Randomized Contention-Based Load-Balancing Protocol for a Distributed Multiserver Queuing System
December 2000 (vol. 11 no. 12)
pp. 1252-1273

Abstract—A novel protocol for load balancing in distributed multiserver queuing systems is proposed. The protocol is based on an anonymous multicast communication in a network of servers or workers. A formal description of the protocol in terms of a state diagram is given. The complexity issues of the protocol are considered. The protocol was investigated by the use of a simulation model in terms of a class of the extended Petri nets and implemented as a prototype system on a group of computers in a LAN of Ethernet type. The results of simulation and prototype-system studies of a distributed queuing system with the proposed protocol are compared to the behavior of an ideal, centralized queuing system. Limitations and possible extensions to the protocol are outlined.

[1] T.C.K. Chow and J.A. Abraham, “Load Balancing in Distributed Systems,” IEEE Trans. Software Eng., vol. 8, no. 7, pp. 401–412, July 1982.
[2] A. Tantawi and D. Towsley, "Optimal Static Load Balancing in Distributed Computer Systems," J. ACM, vol. 32, pp. 445-465, 1985.
[3] N.G. Shivaratri, P. Krueger, and M. Singhal, “Load Distributing for Locally Distributed Systems,” Computer, vol. 25, no. 12, pp. 33-44, Dec. 1992.
[4] B.A. Shirazi, A.R. Hurson, and K.M. Kavi, Scheduling and Load Balancing in Parallel and Distributed Systems. Los Alamitos, Cailf.: IEEE Computer Soc. Press, 1995.
[5] B. Ghosh and S. Muthukrishnan, “Dynamic Load Balancing by Random Matchings,” J. Computer and System Sciences, vol. 53, no. 3, pp. 357–370, 1996.
[6] C.N. Nicolaou and L. Richter, “Special Issue on Load Balancing in Distributed Systems—Introduction,” Information Sciences, vol. 97,nos. 1/2, pp. 1–3, 1997.
[7] B. Schiemann, “Exploiting Interface Definition Languages for Load Balancing,” Information Sciences, vol. 97,nos. 1/2, pp. 221–231, 1997.
[8] S. Dierkes, “Load Balancing with a Fuzzy-Decision Algorithm,” Information Sciences, vol. 97,nos. 1/2, pp. 159–177, 1997.
[9] Y. Azar, B. Kalyanasundaram, S. Plotkin, K.R. Pruhs, and O. Waarts, “Online Load Balancing of Temporary Tasks,” J. Algorithms, vol. 22, no. 1, pp. 93–110, 1997.
[10] X.T. Deng, H.N. Liu, J.S. Long, and B. Xiao, “Competitive Analysis of Network Load Balancing,” J. Parallel and Distributed Computing, vol. 40, no. 2, pp. 162–172, 1997.
[11] L. Kleinrock, Queueing Systems, vol. 2: Computer Applications. John Wiley&Sons, 1976.
[12] R. Jain, The Art of Computer Systems Performance Analysis: Techniques for Experimental Design, Measurement, Simulation, and Modeling. John Wiley&Sons, 1991.
[13] K. Baumgartner and B.W. Wah, “GAMMON: A Load Balancing Strategy for a Local Computer System with a Multiaccess Network,” IEEE Trans. Computers, vol. 38, no. 8, pp. 1,098–1,109. Aug. 1989.
[14] P. Mehara and B.W. Wah, “Automated Learning of Load-Balancing Strategies in Multiprogrammed Distributed Systems,” Int'l J. Systems Science, vol. 28, no. 11, pp. 1,077–1,099, Nov. 1997.
[15] N. Lynch, Distributed Algorithms. New Jersey, Morgan Kaufman, 1996.
[16] A.E. Kostin, “Models and Algorithms for Organization of Distributed Data Processing in Information Systems,” Diss. DSc, Moscow Inst. of Electronic Technology (Technical Univ.), 1989 (in Russian).
[17] A.E. Kostin, “A Protocol for Distributed Scheduling in a Processor Network,” Proc. 11th Int'l Symp. Computer and Information Sciences, pp. 915–924, 1996.
[18] K. Birman and T. Joseph, "Reliable Communications in Presence of Failures," ACM Trans. Computing Systems, vol. 5, no. 1, pp. 47-76, 1987.
[19] M.F. Kaashoek, A.S. Tanenbaum, S. Hummel, and H.E. Bal, “An Efficient Reliable Broadcast Protocol,” Operating Systems Review, vol. 23, no. 4, pp. 5–19, Oct. 1989.
[20] R. van Renesse, K.P. Birman, and S. Maffeis, “Horus: A Flexible Group Communication System,” Comm. ACM, vol. 39, no. 4, pp. 76–83, 1996.
[21] L.E. Moser, P.M. Melliar-Smith, D.A. Agarwal, R.K. Budhia, and C.A. Lingley-Papadopoulos, “Totem: A Fault-Tolerant Multicast Group Communication System,” Comm. ACM, vol. 39, no. 4, pp. 54–63, 1996.
[22] H. Garcia-Molina and A. Spauster,"Ordered and Reliable Multicast Communication," ACM Trans. Computer Systems, vol. 6, no. 3, Aug. 1991, pp. 242-271.
[23] S. Paul, K.K. Sabnani, J.C.H. Lin, and S. Bhattacharyya, “Reliable Multicast Transport Protocol,” IEEE J. Selected Areas in Comm., vol. 15, no. 3, pp. 407–421, Mar. 1997.
[24] A.E. Kostin and L.V. Savtchenko, “Modified E-Nets for Investigation of Distributed Data Processing Systems,” Avtomatika i Vychislitelnaja Tekhnika, pp. 27–35, no. 6, 1988 (in Russian).
[25] A.E. Kostin, “MICROSIM—E-Net Tool for Modelling Networks and Distributed Data Processing Systems,” Proc. First Symp. Computer Networks, pp. 34–46, 1996.
[26] G. Held, Local Area Network Performance: Issues and Answers. John Wiley&Sons, 1994.
[27] K.P. Birman, “Reliable Multicast Goes Mainstream,” at / /www.cri.ensmp.fr ~mukka/tcos/e_bulletin/vol10no1tcos.html , 1997.
[28] K.P. Birman, Building Secure and Reliable Network Applications. Greenwich, Conn.: Manning Publications, 1996.
[29] M.F. Kaashoek and A.S. Tanenbaum, “Group Communication in the Amoeba Distributed Operating System,” Proc. IEEE 11th Int'l Conf. Distributed Computing Systems (ICDCS), pp. 222-230, 1991.
[30] M. Woodroofe, Probability with Applications. McGraw-Hill, 1975.
[31] P. Loshin and F. Kastenholz, Essential Ethernet Standards: RFC's and Protocols Made Practical. John Wiley&Sons, 1999.
[32] J. Watts and S. Taylor, “A Practical Approach to Dynamic Load Balancing,” IEEE Trans. Parallel and Distributed Systems, vol. 9, no. 3, pp. 235–248, Mar. 1998.
[33] J.N. Tsitsiklis and G.D. Stamoulis, “On the Average Communication Complexity of Asynchronous Distributed Algorithms,” J. ACM, vol. 42, no. 2, pp. 382–400, Mar. 1995.
[34] A. Geist, A. Beguelin, J. Dongarra, W. Jiang, R. Manchek,, and V. Sunderam,PVM: Parallel Virtual Machine—A Users' Guide and Tutorial for Networked Parallel Computing. The MIT Press, 1994.

Index Terms:
Distributed systems, queuing systems, load balancing, modeling, simulation.
Alexander E. Kostin, Isik Aybay, Gurcu Oz, "A Randomized Contention-Based Load-Balancing Protocol for a Distributed Multiserver Queuing System," IEEE Transactions on Parallel and Distributed Systems, vol. 11, no. 12, pp. 1252-1273, Dec. 2000, doi:10.1109/71.895792
Usage of this product signifies your acceptance of the Terms of Use.