Proceedings of the 22nd International Conference on Parallel Architectures and Compilation Techniques (1996)
Oct. 20, 1996 to Oct. 23, 1996
Claude G. Diderich , Swiss Federal Institute of Technolog
Marc Gengler , Ecole Normale Suprieure de Lyon
Two important aspects have to be addressed when automatically parallelizing loop nests for massively parallel distributed memory computers, namely maximizing parallelism and minimizing communication overhead due to non local data accesses. This paper studies the problem of finding a computation mapping and data distributions that minimize the number of remote data accesses for a given degree of parallelism. This problem is called the constant-degree parallelism alignment problem. The heuristic presented uses a linear algebra framework and assumes affine data access functions. It proceeds by incrementally building a basis of the set of vectors representing the alignments between computation and data accesses that should be satisfied. The heuristic algorithm is applied to benchmark programs and shown superior to more basic mappings.
Claude G. Diderich, Marc Gengler, "A Heuristic Approach for Finding a Solution to the Constant-Degree Parallelism Alignment Problem", Proceedings of the 22nd International Conference on Parallel Architectures and Compilation Techniques, vol. 00, no. , pp. 0127, 1996, doi:10.1109/PACT.1996.552656