SC Conference (2005)
Nov. 12, 2005 to Nov. 18, 2005
DOI Bookmark: http://doi.ieeecomputersociety.org/10.1109/SC.2005.51
Jarek Nieplocha , Pacific Northwest National Laboratory
Vinod Tipparaju , Pacific Northwest National Laboratory
The paper proposes a novel approach for optimizing performance of all-to-all collective communication by taking advantage of concurrency available in modern networks such as Infiniband or Quadrics. Using the MPI AllGather operation as an example, we describe how network concurrency can be exploited in an optimized implementation of this operation. For example, compared to leading MPI implementations for a 32-KB message on 128 processors, our new algorithm yields a 65% improvement on the Infiniband at Virginia Tech and an 89% improvement on the Quadrics cluster at Pacific Northwest National Laboratory.
Jarek Nieplocha, Vinod Tipparaju, "Optimizing All-to-All Collective Communication by Exploiting Concurrency in Modern Networks", SC Conference, vol. 00, no. , pp. 46, 2005, doi:10.1109/SC.2005.51