The Community for Technology Leaders
Green Image
<p><b>Abstract</b>—Optimizing communication is a key issue in generating efficient SPMD codes in compiling distributed arrays on data parallel languages, such as High Performance Fortran. In HPF, the array distribution may involve alignment and cyclic(k)-distribution such that the enumeration of the local set and the enumeration of the communication set exhibit regular patterns which can be modeled as integer lattices. In the special case of unit-strided alignment, many techniques of the communication set enumeration have been proposed, while in the general case of the non-unit-strided alignment, <it>inspector</it>-like run-time codes are needed to build repeating pattern table or to scan over local elements such that the communication set can be constructed. Unlike other works on this problem of the general alignment and cyclic(k) distribution, our approach derives an algebraic solution for such an integer lattice that models the communication set by using the Smith-Normal-Form analysis, therefore, efficient enumeration of the communication set can be generated. Based on the integer lattice, we also present our algorithm for the SPMD code generation. In our approach, when the parameters are known, the SPMD program can be efficiently constructed without any <it>inspector</it>-like run-time codes.</p>
Distributed arrays, communication optimizations, HPF, message passing, Smith-Normal-Form.
Eric Hung-Yu Tseng, Jean-Luc Gaudiot, "Communication Generation for Aligned and Cyclic(K) Distributions Using Integer Lattice", IEEE Transactions on Parallel & Distributed Systems, vol. 10, no. , pp. 136-146, February 1999, doi:10.1109/71.752780
101 ms
(Ver )