This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Load Balancing Problems for Multiclass Jobs in Distributed/Parallel Computer Systems
March 1998 (vol. 47 no. 3)
pp. 322-332

Abstract—Load balancing problems for multiclass jobs in distributed/parallel computer systems with general network configurations are considered. We construct a general model of such a distributed/parallel computer system. The system consists of heterogeneous host computers/processors (nodes) which are interconnected by a generally configured communication/interconnection network wherein there are several classes of jobs, each of which has its distinct delay function at each host and each communication link. This model is used to formulate the multiclass job load balancing problem as a nonlinear optimization problem in which the goal is to minimize the mean response time of a job.

A number of simple and intuitive theoretical results on the solution of the optimization problem are derived. On the basis of these results, we propose an effective load balancing algorithm for balancing the load over an entire distributed/parallel system. The proposed algorithm has two attractive features. One is that the algorithm can be implemented in a decentralized fashion. Another feature is simple and straightforward structure. Models of nodes, communication networks, and a numerical example are illustrated. The proposed algorithm is compared with a well-known standard steepest-descent algorithm, the FD algorithm. By using numerical experiments, we show that the proposed algorithm has much faster convergence in terms of computational time than the FD algorithm.

[1] A. O. Allen,Probability, Statistics, and Queueing Theory with Computer Science Applications.New York: Academic, 1978.
[2] F. Baskett, K.M. Chandy, R.R. Muntz, and R. Palacios, “Open, Closed and Mixed Networks of Queues with Different Classes of Customers,” J. ACM, vol. 22, no. 2, pp. 248-260, 1975.
[3] S.C. Dafermos, "The Traffic Assignment Problem for Multiclass-User Transportation Networks," Transportation Science, vol. 6, pp. 73-87, 1972.
[4] S.C. Dafermos and F.T. Sparrow, "The Traffic Assignment Problem for a General Network," J. Research of Nat'l Bureau of Standards-B, vol. 73B, no. 2, pp. 91-118, 1969.
[5] D.L. Eager, E.D. Lazowska, and J. Zahorjan, "Adaptive Load Sharing in Homogeneous Distributed Systems," IEEE Trans. Software Eng., vol. 12, no. 5, pp. 662-675, May 1986.
[6] D.L. Eager, E.D. Lazowska, and J. Zahorjan, "A Comparison of Receiver-Initiated and Sender-Initiated Adaptive Load Sharing," Performance Evaluation, Vol. 6, Mar. 1986, pp. 53-68.
[7] T. Feng, "A Survey of Interconnection Networks," Computer, pp. 12-27, Dec. 1981.
[8] L. Fratta, M. Gerla, and L. Kleinrock, "The Flow Deviation Method: An Approach to Store-and-Forward Communication Network Design," Networks, vol. 3, pp. 97-133, 1973.
[9] M. Harchol-Balter and A.B. Downey, "Exploiting Process Lifetime Distribution for Dynamic Load Balancing," Proc. ACM Sigmetrics Conf., ACM Press, 1996, pp. 13-24.
[10] M.D. Intriligator, Mathematical Optimization and Economic Theory.Englewood Cliffs N.J.: Prentice Hall, Inc., 1971.
[11] H. Kameda, J. Li, C. Kim, and Y. Zhang, Optimal Load Balancing in Distributed Computer Systems.London: Springer-Verlag, 1996.
[12] H. Kameda and Y. Zhang, "Uniqueness of the Solution for Optimal Static Routing in Open BCMP Queueing Networks," Mathematical and Computer Modelling, vol. 22, nos. 10-12, pp. 119-130, 1995.
[13] C. Kim and H. Kameda, "An Algorithm for Optimal Static Load Balancing in Distributed Computer Systemsm," IEEE Trans. Computers vol. 41, no. 3, pp. 381-384, Mar. 1992.
[14] C. Kim and H. Kameda, "Optimal Static Load Balancing of Multi-Class Jobs in a Distributed Computer System," Trans. IEICE, vol. 73, no. 7, pp. 1,207-1,214, July 1990. Full name of journal?
[15] L. Kleinrock, Queueing Systems, Vol. 2: Computer Applications.New York: John Wiley&Sons, Inc., 1976.
[16] J. Li and H. Kameda, "Optimal Static Load Balancing in Tree Network Configurations with Two-Way Traffic," Computer Networks and ISDN Systems, vol. 25, no. 12, pp. 1,335-1,348, 1993.
[17] J. Li and H. Kameda, "A Decomposition Algorithm for Optimal Static Load Balancing in Tree Hierarchy Network Configurations," IEEE Trans. Parallel and Distributed Systems, vol. 5, no. 5, pp. 540-548, May 1994.
[18] J. Li and H. Kameda, "Optimal Load Balancing in Star Network Configurations with Two-Way Traffic," J. Parallel and Distributed Computing, vol. 23, no. 3, pp. 364-375, Dec. 1994.
[19] F.C.H. Lin and R.M. Keller, “The Gradient Model Load Balancing Method,” IEEE Trans. Software Eng., vol. 13, no. 1, pp. 32-38, Jan. 1987.
[20] K.W. Ross and D.D. Yao, "Optimal Load Balancing and Scheduling in a Distributed Computer System," J. ACM, vol. 38, no. 3, pp. 676-690, July 1991.
[21] K.G. Shin and Y.C. Chang, “A Coordinated Location Policy for Local Sharing in Hypercube-Connected Machines,” Trans. Computers, vol. 44, no. 5, May 1995.
[22] A.N. Tantawi and D. Towsley, "A General Model for Optimal Static Load Balancing in Star Network Configurations," Proc. PERFORMANCE '84, E. Gelenbe, ed., pp. 277-291.North-Holland: Elsevier Science Publishers B.V., 1985.
[23] A. Tantawi and D. Towsley, "Optimal Static Load Balancing in Distributed Computer Systems," J. ACM, vol. 32, pp. 445-465, 1985.
[24] D.J. Wilde and C.S. Beightler, Foundations of Optimization.Englewood Cliffs N.J.: Prentice Hall, 1967.
[25] Y. Zhang, H. Kameda, and K. Shimizu, "Adaptive Bidding Load Balancing Algorithms in Heterogeneous Distributed Systems," Proc. IEEE Second Int'l Workshop Modeling, Analysis, and Simulation of Computer and Telecomm. Systems, pp. 250-254,Durham, N.C., Jan. 1994.
[26] Y. Zhang, K. Hakozaki, H. Kameda, and K. Shimizu, "A Performance Comparison of Adaptive and Static Load Balancing in Heterogeneous Distributed Systems," Proc. IEEE 28th Ann. Simulation Symp., pp. 332-340,Phoenix, Ariz., Apr. 1995.

Index Terms:
Algorithms, communication networks, distributed/parallel computer systems, interconnection networks, load balancing, management, multiclass jobs, nonlinear optimization, performance, queuing theory.
Citation:
Jie Li, Hisao Kameda, "Load Balancing Problems for Multiclass Jobs in Distributed/Parallel Computer Systems," IEEE Transactions on Computers, vol. 47, no. 3, pp. 322-332, March 1998, doi:10.1109/12.660168
Usage of this product signifies your acceptance of the Terms of Use.