loading...
 This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
2006 15th IEEE International Conference on High Performance Distributed Computing
Improving the Performance of Remote I/O Using Asynchronous Primitives
Paris
June 19-June 23
ISBN: 1-4244-0307-3
N. Ali, Dept. of Comput. Sci.&Eng., Ohio State Univ., Columbus, OH
M. Lauria, Dept. of Comput. Sci.&Eng., Ohio State Univ., Columbus, OH
An increasing number of scientific applications need efficient access to large datasets held at remote storage facilities. However, despite the availability of high-speed Internet backbones, the performance penalty of remote I/O is still relatively high compared to local I/O. In this paper we describe different ways in which asynchronous primitives can be used to improve the performance of remote I/O in the grid environment. We have implemented and evaluated three optimization techniques using asynchronous primitives. These primitives have been integrated into SEMPLAR, a high-performance, remote I/O library based on the SDSC storage resource broker. Based on measurements of representative high-performance applications running on three different clusters, we show that different optimization techniques work best for each specific combination of application and platform characteristics. We achieved over 90% overlap between the computation and I/O phase of two applications by using an asynchronous version of remote I/O primitives. We were able to increase the average read and write bandwidth of the ROMIO perf benchmark by 96% and 43% respectively by moving data concurrently over multiple remote connections. Finally, we experienced an improvement of up to 84% in the average write bandwidth when using asynchronous, on-the-fly data compression
Index Terms:
data compression, remote I/O performance, asynchronous primitive, scientific application, remote storage facility, high-speed Internet service, grid environment, optimization technique, SEMPLAR remote I/O library, SDSC storage resource broker
Citation:
N. Ali, M. Lauria, "Improving the Performance of Remote I/O Using Asynchronous Primitives," hpdc, pp.218-228, 2006 15th IEEE International Conference on High Performance Distributed Computing, 2006
Usage of this product signifies your acceptance of the Terms of Use.