The Community for Technology Leaders
Green Image
<p><b>Abstract</b>—This paper presents a framework, based on global array data-flow analysis, to reduce communication costs in a program being compiled for a distributed memory machine. We introduce <it>available section descriptor</it>, a novel representation of communication involving array sections. This representation allows us to apply techniques for partial redundancy elimination to obtain powerful communication optimizations. With a single framework, we are able to capture optimizations like 1) vectorizing communication, 2) eliminating communication that is redundant on any control flow path, 3) reducing the amount of data being communicated, 4) reducing the number of processors to which data must be communicated, and (5) moving communication earlier to hide latency, and to subsume previous communication. We show that the bidirectional problem of eliminating partial redundancies can be decomposed into simpler unidirectional problems even in the context of an array section representation, which makes the analysis procedure more efficient. We present results from a preliminary implementation of this framework, which are extremely encouraging, and demonstrate the effectiveness of this analysis in improving the performance of programs.</p>
Array section descriptors, communication optimizations, data availability, data-flow analysis, data-parallelism, High Performance Fortran, partial redundancy elimination.
Harini Srinivasan, Edith Schonberg, Manish Gupta, "A Unified Framework for Optimizing Communication in Data-Parallel Programs", IEEE Transactions on Parallel & Distributed Systems, vol. 7, no. , pp. 689-704, July 1996, doi:10.1109/71.508249
98 ms
(Ver )