13th International Parallel Processing Symposium and 10th Symposium on Parallel and Distributed Processing
Reducing I/O Complexity by Simulating Coarse Grained Parallel Algorithms
San Juan, Puerto Rico
April 12-April 16
ISBN: 0-7695-0143-5
Block-wise access to data is a central theme in the design of efficient {\em external memory} (EM) algorithms. A second important issue, when more than one disk is present, is fully parallel disk I/O. In this paper we present a {\em deterministic simulation} technique which transforms parallel algorithms into (parallel) external memory algorithms. Specifically, we present a {\em deterministic} simulation technique which transforms {\em Coarse Grained Multicomputer} (CGM) algorithms into external memory algorithms for the {\em Parallel Disk Model}. Our technique optimizes block-wise data access and parallel disk I/O and, at the same time, utilizes {\em multiple processors} connected via a communication network or shared memory.We obtain new improved parallel external memory algorithms for a large number of problems including sorting, permutation, matrix transpose, several geometric and GIS problems including 3D convex hulls (2D Voronoi diagrams), and various graph problems. All of the (parallel) external memory algorithms obtained via simulation are analyzed with respect to the computation time, communication time and the number of I/O's. Our results answer to the challenge posed by the ACM working group on storage I/O for large-scale computing
Citation:
Frank Dehne, David Hutchinson, Anil Maheshwari, Wolfgang Dittrich, "Reducing I/O Complexity by Simulating Coarse Grained Parallel Algorithms," ipps, pp.14, 13th International Parallel Processing Symposium and 10th Symposium on Parallel and Distributed Processing, 1999