loading...
 This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Sixth IEEE International Conference on Cluster Computing (CLUSTER'04)
Scalable, high-performance NIC-based all-to-all broadcast over Myrinet/GM
San Diego, CA, USA
September 20-September 23
ISBN: 0-7803-8694-9
Weikuan Yu, Dept. of Comput. Sci. & Eng., Ohio State Univ., Columbus, OH, USA
D.K. Panda, Dept. of Comput. Sci. & Eng., Ohio State Univ., Columbus, OH, USA
D. Buntinas, LRI, Univ. de Paris Sud, Orsay, France
All-to-all broadcast is one of the common collective operations that involve dense communication between all processes in a parallel program. Previously, programmable network interface cards (NICs) have been leveraged to efficiently support collective operations, including barrier, broadcast, and reduce. This work explores the characteristics of all-to-all broadcast and proposes new algorithms to exploit the potential advantages of NIC programmability. Along with these algorithms, salient strategies have been used to provide scalable topology management, global buffer management, efficient communication processing, and message reliability. The algorithms have been incorporated into a NIC-based collective protocol over Myrinet/GM. The NIC-based all-to-all broadcast operations improve all-to-all broadcast bandwidth over 16 nodes by a factor of 3, compared to host-based all-to-all broadcast operation. Furthermore, the NIC-based operations have been demonstrated to achieve better scalability to large systems and very low host CPU utilization.
Citation:
Weikuan Yu, D.K. Panda, D. Buntinas, "Scalable, high-performance NIC-based all-to-all broadcast over Myrinet/GM," cluster, pp.125-134, Sixth IEEE International Conference on Cluster Computing (CLUSTER'04), 2004
Usage of this product signifies your acceptance of the Terms of Use.