loading...
 This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Fourth IEEE International Conference on Cluster Computing (CLUSTER'02)
Noncontiguous I/O through PVFS
Chicago, Illinois
September 23-September 26
ISBN: 0-7695-1745-5
Avery Ching, Northwestern University
Alok Choudhary, Northwestern University
Wei-keng Liao, Northwestern University
Rob Ross, Argonne National Laboratory
William Gropp, Argonne National Laboratory
With the tremendous advances in processor and memory technology, I/O has risen to become the bottleneck in high-performance computing for many applications. The development of parallel file systems has helped to ease the performance gap, but I/O still remains an area needing significant performance improvement. Research has found that noncontiguous I/O access patterns in scientific applications combined with current file system methods to perform these accesses lead to unacceptable performance for large data sets. To enhance performance of noncontiguous I/O, we have created list I/O, a native version of noncontiguous I/O. We have used the Parallel Virtual File System (PVFS) to implement our ideas. Our research and experimentation shows that list I/O outperforms current noncontiguous I/O access methods in most I/O situations and can substantially enhance the performance of real-world scientific applications.
Citation:
Avery Ching, Alok Choudhary, Wei-keng Liao, Rob Ross, William Gropp, "Noncontiguous I/O through PVFS," cluster, pp.405, Fourth IEEE International Conference on Cluster Computing (CLUSTER'02), 2002
Usage of this product signifies your acceptance of the Terms of Use.