Automatic Partitioning of Parallel Loops and Data Arrays for Distributed Shared-Memory Multiprocessors
Issue No. 09 - September (1995 vol. 6)
DOI Bookmark: http://doi.ieeecomputersociety.org/10.1109/71.466632
<p><it>Abstract</it>—This paper presents a theoretical framework for automatically partitioning parallel loops to minimize cache coherency traffic on shared-memory multiprocessors. While several previous papers have looked at hyperplane partitioning of iteration spaces to reduce communication traffic, the problem of deriving the <it>optimal</it> tiling parameters for minimal communication in loops with general affine index expressions has remained open. Our paper solves this open problem by presenting a method for deriving an optimal hyperparallelepiped tiling of iteration spaces for minimal communication in multiprocessors with caches. We show that the same theoretical framework can also be used to determine optimal tiling parameters for both data and loop partitioning in distributed memory multicomputers. Our framework uses matrices to represent iteration and data space mappings and the notion of uniformly intersecting references to capture temporal locality in array references. We introduce the notion of data footprints to estimate the communication traffic between processors and use linear algebraic methods and lattice theory to compute precisely the size of data footprints. We have implemented this framework in a compiler for Alewife, a distributed shared-memory multiprocessor.</p>
Automatic loop partitioning, shared-memory multiprocessors, compilers, tiling, minimizing communication.
Anant Agarwal, David A. Kranz, Venkat Natarajan, "Automatic Partitioning of Parallel Loops and Data Arrays for Distributed Shared-Memory Multiprocessors", IEEE Transactions on Parallel & Distributed Systems, vol. 6, no. , pp. 943-962, September 1995, doi:10.1109/71.466632