International Parallel and Distributed Processing Symposium (IPDPS'03)
A Framework for Collective Personalized Communication
Nice, France
April 22-April 26
ISBN: 0-7695-1926-1
This paper explores collective personalized communication. For example, in all-to-all personalized communication (AAPC), each processor sends a distinct message to every other processor. However, for many applications, the collective communication pattern is many-to-many, where each processor sends a distinct message to a subset of processors. In this paper we first present strategies that reduce per-message cost to optimize AAPC. We then present performance results of these strategies in both all-to-all and many-to-many scenarios. These strategies are implemented in a flexible, asynchronous library with a non-blocking interface, and a message-driven runtime system. This allows the collective communication to run concurrently with the application, if desired. As a result the computational overhead of the communication is substantially reduced, at least on machines such as PSC Lemieux, which sport a co-processor capable of remote DMA. We demonstrate the advantages of our framework with performance results on several benchmarks and applications.
Citation:
Laxmikant V. Kalé, Sameer Kumar, Krishnan Varadarajan, "A Framework for Collective Personalized Communication," ipdps, pp.69a, International Parallel and Distributed Processing Symposium (IPDPS'03), 2003