• Publication
  • 1997
  • Issue No. 8 - August
  • Abstract - Minimizing the Application Execution Time Through Scheduling of Subtasks and Communication Traffic in a Heterogeneous Computing System
 This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Minimizing the Application Execution Time Through Scheduling of Subtasks and Communication Traffic in a Heterogeneous Computing System
August 1997 (vol. 8 no. 8)
pp. 857-871

Abstract—In a heterogeneous computing (HC) environment consisting of different types of machines, an application program is decomposed into subtasks, each of which is computationally homogeneous. The goal is to execute subtasks on the machines in such a way that the total program execution time is minimized. A mathematical framework is presented that models the matching of subtasks to machines, scheduling of subtasks' computation, scheduling of intermachine communication steps, and selection of sources of shared data items for intermachine communication (data relocation). The goal of this work is to generate a provably optimal scheme for communicating shared data among subtasks as an enhancement to any given matching and scheduling. Initially, it is assumed that at any instant in time, only one machine is being used for program execution and only one subtask is being executed. Based on this assumption, a polynomial algorithm is introduced to optimize scheduling and data relocation with respect to any given matching of subtasks to machines. The data relocation scheme is then extended to reduce intermachine data communication time in an HC environment with a given matching and scheduling of subtasks' computation where: 1) multiple subtasks' computations can be performed concurrently on different machines; 2) subtask computation stteps can be overlapped with other subtasks' communication steps for intermachine data transfers; and 3) machines in the HC suite are interconnected by a shared-bus type of network.

[1] I. Ahmad and Y.K. Kwok, "A Parallel Approach for Multiprocessor Scheduling," Proc. Int'l Parallel Processing Symp., pp. 289-293, Apr. 1995.
[2] S.H. Bokhari, "A Shortest Tree Algorithm for Optimal Assignments Across Space and Time in a Distributed Processor System," IEEE Trans. Software Eng., vol. 7, no. 6, pp. 583-589, Nov. 1981.
[3] J.A. Bondy and U.S.R. Murty, Graph Theory with Applications.New York: Elsevier Science, 1976.
[4] S. Chen, M.M. Eshaghian, A. Khokhar, and M.E. Shaaban, "A Selection Theory and Methodology for Heterogeneous Supercomputing," Proc. Workshop Heterogeneous Processing, pp. 15-22, Apr. 1993.
[5] M. Cierniak, W. Li, and M.J. Zaki, "Loop Scheduling for Heterogeneity," Proc. Fourth IEEE Int'l Symp. High-Performance Distributed Computing, pp. 78-85, Aug. 1995.
[6] T.H. Cormen,C.E. Leiserson, and R.L. Rivest,Introduction to Algorithms.Cambridge, Mass.: MIT Press/McGraw-Hill, 1990.
[7] D. Fernandez-Baca, "Allocating Modules to Processors in a Distributed System," IEEE Trans. Software Eng., vol. 15, no. 11, pp. 1,427-1,436, Nov. 1989.
[8] R.F. Freund, "Optimal Selection Theory for Superconcurrency," Proc. Supercomputing '89, pp. 699-703, 1989.
[9] R.F. Freund and H.J. Siegel, "Heterogeneous Processing," Computer, vol. 26, no. 6, pp. 13-17, June 1993.
[10] Ghafoor and J. Yang, "A Distributed Heterogeneous Supercomputing Management System," Computer, Vol. 26, No. 6, June 1993, pp. 78-86.
[11] A. Khokhar, V.K. Prasanna, M. Shaaban, and C.L. Wang, "Heterogeneous Supercomputing: Problems and Issues," Proc. Workshop Heterogeneous Processing, pp. 3-12, Mar. 1992.
[12] A.A. Khokhar, V.K. Prasanna, M.E. Shaaban,, and C.L. Wang, “Heterogeneous Computing: Challenges and Opportunities,” Computer, pp. 18-27, June 1993.
[13] A.E. Klietz, A.V. Malevsky, and K. Chin-Purcell, "A Case Study in Metacomputing: Distributed Simulations of Mixing in Turbulent Convection," Proc. Workshop Heterogeneous Processing, pp. 101-106, Apr. 1993.
[14] V.M. Lo, "Heuristic Algorithms for Task Assignment in Distributed Systems," IEEE Trans. Computers, vol. 37, no. 11, pp. 1,384-1,397, Nov. 1988.
[15] B. Narahari, A. Youssef, and H.A. Choi, "Matching and Scheduling in a Generalized Optimal Selection Theory," Proc. Heterogeneous Computing Workshop, pp. 3-8, Apr. 1994.
[16] H.J. Siegel, J.K. Antonio, R.C. Metzger, M. Tan, and Y.A. Li, "Heterogeneous Computing," Parallel and Distributed Computing Handbook, A.Y. Zomaya, ed., pp. 725-761.New York: McGraw-Hill, 1996.
[17] H.J. Siegel, H.G. Dietz, and J.K. Antonio, “Software Support for Heterogeneous Computing,” ACM Computing Surveys, vol. 28, no. 1, pp. 237-239, 1996.
[18] G.C. Sih and E.A. Lee, “A Compile-Time Scheduling Heuristic for Interconnection-Constrained Heterogeneous Processor Architectures,” IEEE Trans. Parallel and Distributed Systems, vol. 4, no. 2, pp. 175-186, Feb. 1993.
[19] H.S. Stone, "Multiprocessor Scheduling with the Aid of the Network Flow Algorithms," IEEE Trans. Software Eng., vol. 3, no. 1, pp. 85-93, Jan. 1977.
[20] M. Tan, J.K. Antonio, H.J. Siegel, and Y.A. Li, "Impact of Data-Reuse and Multiple Data-Copies in a Heterogeneous Computing System with Sequentially Executed Subtasks," TR-EE 95-2, Electrical Eng. School, Purdue Univ., 34 pp., Jan. 1995.
[21] D.F. Towsley, "Allocating Programs Containing Branches and Loops within a Multiple Processor System," IEEE Trans. Software Eng., vol. 12, pp. 1,018-1,024, Oct. 1986.
[22] M. Wang, S.-D. Kim, M.A. Nichols, R.F. Freund, H.J. Siegel, and W.G. Nation, "Augmenting the Optimal Selection Theory for Superconcurrency," Proc. Workshop Heterogeneous Processing, pp. 13-22, Mar. 1992.
[23] J. Yang, A. Khokhar, S. Sheikh, and A. Ghafoor, "Estimating Execution Time for Parallel Tasks in Heterogeneous Processing (HP) Environment," Proc. Heterogeneous Computing Workshop, pp. 23-28, Apr. 1994.
[24] X. Zhang and Y. Yan, "Modeling and Characterizing Parallel Computing Performance on Heterogeneous Networks of Workstations," Proc. Seventh IEEE Symp. Parallel and Distributed Processing, pp. 25-34, Oct. 1995.

Index Terms:
Data distribution, data relocation, data-reuse, distributed computing, heterogeneous computing, multiple data-copies, optimization, scheduling.
Citation:
Min Tan, Howard Jay Siegel, John K. Antonio, Yan Alexander Li, "Minimizing the Application Execution Time Through Scheduling of Subtasks and Communication Traffic in a Heterogeneous Computing System," IEEE Transactions on Parallel and Distributed Systems, vol. 8, no. 8, pp. 857-871, Aug. 1997, doi:10.1109/71.605771
Usage of this product signifies your acceptance of the Terms of Use.