Issue No.02 - March (1981 vol.7)
B. Lint , IBM Federal Systems Division
As multiple processor systems become more widely accepted the importance of parallel programming increases. In this paper, approaches to the design and analysis of parallel algorithms are investigated. Through several examples, the importance of interprocessor communication in parallel processing is demonstrated. Various techniques that are applicable in the design and analysis of parallel algorithms are examined with emphasis on those techniques that incorporate communication aspects. The paper discusses several models of synchronous and asynchronous parallel computation and their use in analyzing algorithms. Relatively primitive methodologies for designing parallel algorithms are discussed and the need for more general and practical methodologies is indicated.
parallel programming, Analysis of algorithms, models of parallel computation, module assignment problem, multiprocessing
B. Lint, T. Agerwala, "Communication Issues in the Design and Analysis of Parallel Algorithms", IEEE Transactions on Software Engineering, vol.7, no. 2, pp. 174-188, March 1981, doi:10.1109/TSE.1981.230833