loading...
 This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Sixth IEEE International Conference on Cluster Computing (CLUSTER'04)
The design and implementation of an asynchronous communication mechanism for the MPI communication model
San Diego, CA, USA
September 20-September 23
ISBN: 0-7803-8694-9
M. Matsuda, Grid Technol. Res. Center, National Inst. of Adv. Ind. Sci. & Technol., Ibaraki, Japan
T. Kudoh, Grid Technol. Res. Center, National Inst. of Adv. Ind. Sci. & Technol., Ibaraki, Japan
H. Tazuka, Grid Technol. Res. Center, National Inst. of Adv. Ind. Sci. & Technol., Ibaraki, Japan
Many implementations of an MPI communication library are realized on top of the socket interface which is based on connection-oriented stream communication. This work addresses a mismatch between the MPI communication model and the socket interface. In order to overcome a mismatch and implement an efficient MPI library for large-scale commodity-based clusters, a new communication mechanism, called 02G, is designed and implemented. O2G integrates receive queue management of MPI into a TCP/IP protocol handler, without modifying the protocol stacks. Received data is extracted from the TCP receive buffer and copied into the user space within the TCP/IP protocol handler invoked by interrupts. It totally avoids polling of sockets and reduces system call overhead, which becomes dominant in large-scale clusters. In addition, its immediate and asynchronous receive operation avoids message flow disruption due to a shortage of capacity in the receive buffer, and keeps the bandwidth high. An evaluation using the NAS Parallel Benchmarks shows that 02G made an MPI implementation up to 30 percent faster than the original one. An evaluation on bandwidth also shows that 02G made an MPI implementation independent of the number of connections, while an implementation with sockets was greatly affected by the number of connections.
Citation:
M. Matsuda, T. Kudoh, H. Tazuka, Y. Ishikawa, "The design and implementation of an asynchronous communication mechanism for the MPI communication model," cluster, pp.13-22, Sixth IEEE International Conference on Cluster Computing (CLUSTER'04), 2004
Usage of this product signifies your acceptance of the Terms of Use.