loading...
 This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
2004 IEEE International Symposium on Performance Analysis of Systems and Software (ISPASS'04)
Sockets Direct Protocol over InfiniBand in clusters: is it beneficial?
Austin, TX, USA
March 10-March 12
ISBN: 0-7803-8385-0
P. Balaji, Comput. & Inf. Sci., Ohio State Univ., Columbus, OH, USA
S. Narravula, Comput. & Inf. Sci., Ohio State Univ., Columbus, OH, USA
K. Vaidyanathan, Comput. & Inf. Sci., Ohio State Univ., Columbus, OH, USA
S. Krishnamoorthy, Comput. & Inf. Sci., Ohio State Univ., Columbus, OH, USA
J. Wu, Comput. & Inf. Sci., Ohio State Univ., Columbus, OH, USA
D.K. Panda, Comput. & Inf. Sci., Ohio State Univ., Columbus, OH, USA
The Sockets Direct Protocol (SDP) had been proposed recently in order to enable sockets based applications to take advantage of the enhanced features provided by InfiniBand architecture. In this paper, we study the benefits and limitations of an implementation of SDP. We first analyze the performance of SDP based on a detailed suite of micro-benchmarks. Next, we evaluate it on two different real application domains: (1) A multitier data-center environment and (2) A Parallel Virtual File System (PVFS). Our micro-benchmark results show that SDP is able to provide up to 2.7 times better bandwidth as compared to the native sockets implementation over InfiniBand (IPoIB) and significantly better latency for large message sizes. Our experimental results also show that SDP is able to achieve a considerably higher performance (improvement of up to 2.4 times) as compared to IPoIB in the PVFS environment. In the data-center environment, SDP outperforms IPoIB for large file transfers inspite of currently being limited by a high connection setup time. However, this limitation is entirely implementation specific and as the InfiniBand software and hardware products are rapidly maturing, we expect this limitation to be overcome soon. Based on this, we have shown that the projected performance for SDP, without the connection setup time, can outperform IPoIB for small message transfers as well.
Citation:
P. Balaji, S. Narravula, K. Vaidyanathan, S. Krishnamoorthy, J. Wu, D.K. Panda, "Sockets Direct Protocol over InfiniBand in clusters: is it beneficial?," ispass, pp.28-35, 2004 IEEE International Symposium on Performance Analysis of Systems and Software (ISPASS'04), 2004
Usage of this product signifies your acceptance of the Terms of Use.