
This Article  
 
Share  
Bibliographic References  
Add to:  
Digg Furl Spurl Blink Simpy Del.icio.us Y!MyWeb  
Search  
 
ASCII Text  x  
Jeeho Sohn, Thomas G. Robertazzi, Serge Luryi, "Optimizing Computing Costs Using Divisible Load Analysis," IEEE Transactions on Parallel and Distributed Systems, vol. 9, no. 3, pp. 225234, March, 1998.  
BibTex  x  
@article{ 10.1109/71.674315, author = {Jeeho Sohn and Thomas G. Robertazzi and Serge Luryi}, title = {Optimizing Computing Costs Using Divisible Load Analysis}, journal ={IEEE Transactions on Parallel and Distributed Systems}, volume = {9}, number = {3}, issn = {10459219}, year = {1998}, pages = {225234}, doi = {http://doi.ieeecomputersociety.org/10.1109/71.674315}, publisher = {IEEE Computer Society}, address = {Los Alamitos, CA, USA}, }  
RefWorks Procite/RefMan/Endnote  x  
TY  JOUR JO  IEEE Transactions on Parallel and Distributed Systems TI  Optimizing Computing Costs Using Divisible Load Analysis IS  3 SN  10459219 SP225 EP234 EPD  225234 A1  Jeeho Sohn, A1  Thomas G. Robertazzi, A1  Serge Luryi, PY  1998 KW  Bus network KW  computer utility KW  cost KW  divisible load KW  load sharing. VL  9 JA  IEEE Transactions on Parallel and Distributed Systems ER   
Abstract—A bus oriented network where there is a charge for the amount of divisible load processed on each processor is investigated. A cost optimal processor sequencing result is found which involves assigning load to processors in nondecreasing order of the cost per load characteristic of each processor. More generally, one can trade cost against solution time. Algorithms are presented to minimize computing cost with an upper bound on solution time and to minimize solution time with an upper bound on cost. As an example of the use of this type of analysis, the effect of replacing one fast but expensive processor with a number of cheap but slow processors is also discussed. The type of questions investigated here are important for future computer utilities that perform distributed computation for some charge.
[1] I. Ahmad, A. Ghafoor, and G.C. Fox, "Hierarchical Scheduling of Dynamic Parallel Computations on Hypercube Multicomputers," J. Parallel and Distributed Computing, vol. 20, pp. 317329, 1994.
[2] S.H. Bokhari, "A Network Flow Model for Load Balancing in CircuitSwitched Multicomputers," IEEE Trans. Parallel and Distributed Systems, vol. 4, no. 6, pp. 649657, June 1993.
[3] C.H. Lee, D. Lee, and M. Kim, "Optimal Task Assignment in Linear Array Networks," IEEE Trans. Computers, vol. 41, no. 7, pp. 877880, July 1992.
[4] K.K. Goswami, M. Devarakonda, and R.K. Iyer, "PredictionBased Dynamic LoadSharing Heuristics," IEEE Trans. Parallel and Distributed Systems, vol. 4, no. 6, pp. 638648, June 1993.
[5] G. Huang and W. Ongsakul, "An Efficient LoadBalancing Processor Scheduling Algorithm for Parallelization of GaussSeidel Type Algorithms," J. Parallel and Distributed Computing, vol. 22, pp. 350358, 1994.
[6] V.M. Lo, S. Rajopadhye, S. Gupta, D. Keldsen, M.A. Mohamed, and J. Telle, "Mapping Divide and Conquer Algorithms to Parallel Computers," Proc. 1990 Int'l Conf. Parallel Architectures, pp. 128135, 1990.
[7] K. Ramamritham, J. Stankovic, and P. Shiah, “Efficient Scheduling Algorithms for RealTime Multiprocessor Systems,” IEEE Trans. Parallel and Distributed Systems, vol. 1, no. 2, Apr. 1990.
[8] X. Qian and Q. Yang, "An Analytical Model for Load Balancing on Symmetric Multiprocessor Systems," J. Parallel and Distributed Computing, vol. 20, pp. 198211, 1994.
[9] Y.C. Chang and K.G. Shin, "Optimal Load Sharing in Distributed RealTime Systems," J. Parallel and Distributed Computing, vol. 19, no. 1, pp. 3850, Sept. 1993.
[10] K.G. Shin and M.S. Chen, "On the Number of Acceptable Task Assignments in Distributed Computing Systems," IEEE Trans. Computers, vol. 39, no. 1, pp. 99110, Jan. 1990.
[11] D.T. Peng and K.G. Shin, "A New Performance Measure for Scheduling Independent RealTime Tasks," J. Parallel and Distributed Computing, vol. 19, no. 1, pp. 1126, Sept. 1993.
[12] G.C. Sih and E.A. Lee, “Declustering: A New Multiprocessor Scheduling Technique,” IEEE Trans. Parallel and Distributed Systems, vol. 4, no. 6, pp. 625637, June 1993.
[13] J. Xu and K. Hwang, "Heuristic Methods for Dynamic Load Balancing in a MessagePassing Multicomputer," J. Parallel and Distributed Computing, vol. 18, no. 1, pp. 113, May 1993.
[14] J. Blazerwicz,M. Drabowski,, and j. Weglarz,“Scheduling multiprocessor tasks to minimize schedule length,” IEEE Trans. on Computers, vol. 35, no. 5, May 1986.
[15] J. Du and J. Leung,“Complexity of scheduling parallel task systems,”SIAM J. Discrete Math., vol. 2 no. 4, pp. 473–487, Nov. 1989.
[16] W. Zhao, K. Ramamritham, and J.A. Stankovic, "Preemptive Scheduling Under Time and Resource Constraints," IEEE Trans. Computers, Vol. 36, No. 8, Aug. 1987, pp. 949960.
[17] Y.C. Cheng and T.G. Robertazzi, Distributed Computation with Communication Delays IEEE Trans. Aerospace and Electronic Systems, vol. 24, no. 6, pp. 700712, Nov. 1988.
[18] Y.C. Cheng and T.G. Robertazzi, "Distributed Computation for a Tree Network with Communication Delays," IEEE Trans. Aerospace and Electronic Systems, vol. 26, no. 3, pp. 511516, May 1990.
[19] S. Bataineh and T.G. Robertazzi, "Distributed Computation for a Bus Network with Communication Delays," Proc. 1991 Conf. Information Sciences and Systems, pp. 709714, Johns Hopkins Univ., Baltimore, Md., Mar. 1991.
[20] S. Bataineh and T.G. Robertazzi, Bus Oriented Load Sharing for a Network of Sensor Driven Processors IEEE Trans. Systems, Man and Cybernetics, special issue on distributed sensor networks, vol. 21, no. 5, pp. 12021205, Sept. 1991.
[21] S. Bataineh and T.G. Robertazzi, "Performance Limits for Processor Networks with Divisible Jobs," IEEE Trans. Aerospace and Electronic Systems, vol. 33, no. 4, pp. 1,1891,198, Oct. 1997.
[22] S. Bataineh, T. Hsiung, and T.G. Robertazzi, Closed Form Solutions for Bus and Tree Networks of Processors Load Sharing a Divisible Job IEEE Trans. Computers, vol. 43, no. 10, pp. 11841196, Oct. 1994.
[23] T.G. Robertazzi, "Processor Equivalence for a Linear Daisy Chain of Load Sharing Processors," IEEE Trans. Aerospace and Electronic Systems, vol. 29, no. 4, pp. 1,2161,221, Oct. 1993.
[24] J. Sohn and T.G. Robertazzi, Optimal Load Sharing for a Divisible Job on a Bus Network IEEE Trans. Aerospace and Electronic Systems, vol. 32, no. 1, pp. 3440, Jan. 1996.
[25] J. Sohn and T.G. Robertazzi, "A MultiJob Load Sharing Strategy for Divisible Jobs on Bus Networks," Technical Report 697, State Univ. of New York at Stony Brook, College of Eng. and Applied Science, Aug. 1994. Also appears in chapter 12 of [45].
[26] J. Sohn and T.G. Robertazzi, "An Optimal Load Sharing Strategy for Divisible Jobs with TimeVarying Processor Speed and Channel Speed," Conf. version: Proc. ISCA Int'l Conf. Parallel and Distributed Computing Systems, pp. 2732,Orlando Fla., Sept. 1995. Journal version: Accepted for IEEE Trans. Aerospace and Electronic Systems, July 1998.
[27] D. Ghose and V. Mani, "Distributed Computation in a Linear Network: Closedform Solutions and Computational Techniques," IEEE Trans. Aerospace and Electronic Systems, vol. 30, no. 2, pp. 471483, Apr. 1994.
[28] D. Ghose and V. Mani, "Distributed Computation with Communication Delays: Asymptotic Performance Analysis," J. Parallel and Distributed Computing, vol. 23, pp. 293305, Nov. 1994.
[29] V. Bharadwaj, D. Ghose, and V. Mani, "Optimal Sequencing and Arrangement in Distributed SingleLevel Tree Networks with Communication Delays," IEEE Trans. Parallel and Distributed Systems, vol. 5, no. 9, pp. 968976, Sept. 1994.
[30] V. Bharadwaj, D. Ghose, and V. Mani, Multiinstallment Load Distribution in Tree Networks With Delays IEEE Trans. Aerospace and Electronic Systems, vol. 31, no. 2, pp. 555567, 1995.
[31] V. Bharadwaj, D. Ghose, and V. Mani, "An Efficient Load Distribution Strategy for a Distributed Linear Network of Processors with Communication Delays," Computer and Mathematics with Applications, vol. 29, no. 9, pp. 95112, May 1995.
[32] V. Bharadwaj, D. Ghose, and V. Mani, "A Study of Optimality Conditions for Load Distribution in Tree Networks with Communication Delays," Technical Report 423/GI/0292, Dept. of Aerospace Eng., Indian Inst. of Science, Bangalore, India, Dec. 1992.
[33] H.J. Kim, G.I. Jee, and J.G. Lee, "Optimal Load Distribution for Tree Network Processors," IEEE Trans. Aerospace and Electronic Systems, vol. 32, no. 2, pp. 607612, Apr. 1996.
[34] J. Blazewicz and M. Drozdowski, "Scheduling Divisible Jobs on Hypercubes," Parallel Computing, vol. 21, pp. 1,9451,956, 1995.
[35] J. Blazewicz and M. Drozdowski, "The Performance Limits of a TwoDimensional Network of LoadSharing Processors," Foundations of Computing and Decision Sciences, vol. 21, no. 1, pp. 315, 1996.
[36] J. Blazewicz and M. Drozdowski, "Distributed Processing of Divisible Jobs with Communication Startup Costs," Discrete Applied Mathematics, vol. 76, issues 13, pp. 2141, June 1997.
[37] E. Haddad, "Communication Protocol for Optimal Redistribution of Divisible Load in Distributed RealTime Systems," Proc. ISMM Int'l Conf. Intelligent Information Management Systems, pp. 3942,Washington, D.C., June 1994.
[38] J. Sohn, T.G. Robertazzi, and S. Luryi, "Optimizing Computing Costs Using Divisible Load Analysis," State Univ. of New York at Stony Brook, College of Eng. and Applied Science, Technical Report 719, Oct.30, 1995. Also related: US patent application, Load Sharing Controller for Optimizing Monetary Cost, 1996.
[39] R. Cocchi, D. Estrin, S. Shenker, and L. Zhang, “Pricing in Computer Networks: Motivation, Formulation and Examples,” IEEE/ACM Trans. Networking, vol. 1, pp. 614627, 1993.
[40] A. Faragó, S. Blaabjerg, L. Ast, G. Gordos, and T. Henk, "A New Degree of Freedom in ATM Network Dimensioning: Optimizing the Logical Configuration," IEEE J. Selected Areas in Comm., vol. 13, no. 7, pp. 1,1991,205, Sept. 1995.
[41] J. Kurose and R. Simha, “A Microeconomic Approach to Optimal Resource Allocation in Distributed Computer Systems,” IEEE Trans. Computers, vol. 38, no. 5, May 1989.
[42] S.H. Low and P.P Varaiya, "A New Approach to Service Provisioning in ATM Networks," IEEE Trans. Networking, vol. 1, no. 5, pp. 547553, Oct. 1993.
[43] Y.A. Korilis, A.A. Lazar, and A. Orda, "Architecting Noncooperative Networks," IEEE J. Selected Areas in Comm., vol. 13, no. 7, pp. 1,2411,251, Sept. 1995.
[44] D. Menasce and V. Almeida, "CostPerformance Analysis of Heterogeneity in Supercomputer Architectures," Proc. IEEE/ACM Supercomputing '90, pp. 169177, 1990.
[45] V. Bharadwaj, D. Ghose, V. Mani, and T.G. Robertazzi, Scheduling Divisible Loads in Parallel and Distributed Systems.Los Alamitos, Calif.: IEEE CS Press, 1996.