loading...
 This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
12th IEEE International Symposium on High Performance Distributed Computing (HPDC-12 '03)
Impact of High Performance Sockets on Data Intensive Applications
Seattle, Washington
June 22-June 24
ISBN: 0-7695-1965-2
Pavan Balaji, Ohio State University
Jiesheng Wu, Ohio State University
Tahsin Kurc, Ohio State University
Umit Catalyurek, Ohio State University
Dhabaleswar K. Panda, Ohio State University
Joel Saltz, Ohio State University
The challenging issues in supporting data intensive applications on clusters include efficient movement of large volumes of data between processor memories and efficient coordination of data movement and processing by a runtime support to achieve high performance. Such applications have several requirements such as guarantees in performance, scalability with these guarantees and adaptability to heterogeneous environments. With the advent of user-level protocols like the Virtual Interface Architecture (VIA) and the modern InfiniBand Architecture, the latency and bandwidth experienced by applications has approached to that of the physical network on clusters. In order to enable applications written on top of TCP/IP to take advantage of the high performance of these user-level protocols, researchers have come up with a number of techniques including User-Level Sockets Layers over high performance protocols. In this paper, we study the performance and limitations of such a substrate, referred to here as SocketVIA, using a component framework designed to provide runtime support for data intensive applications. The experimental results show that by reorganizing certain components of an application (in our case, the partitioning of a dataset into smaller data chunks), we can make significant improvements in application performance. This leads to a higher scalability of applications with performance guarantees. It also allows fine grained load balancing, hence making applications more adaptable to heterogeneity in resource availability. The experimental results also show that the different performance characteristics of SocketVIA allow a more efficient partitioning of data at the source nodes, thus improving the performance of the application up to an order of magnitude in some cases.
Index Terms:
VIA, High-Performance Networking, Sockets, Data Intensive Computing, PC Clusters
Citation:
Pavan Balaji, Jiesheng Wu, Tahsin Kurc, Umit Catalyurek, Dhabaleswar K. Panda, Joel Saltz, "Impact of High Performance Sockets on Data Intensive Applications," hpdc, pp.24, 12th IEEE International Symposium on High Performance Distributed Computing (HPDC-12 '03), 2003
Usage of this product signifies your acceptance of the Terms of Use.