Cluster Computing and the Grid, IEEE International Symposium on (2006)
May 16, 2006 to May 19, 2006
Peter M. Aarestad , Northwestern University, USA
Avery Ching , Northwestern University, USA
George K. Thiruvathukal , Northwestern University, USA
Alok N. Choudhary , Northwestern University, USA
Scalable atomic and parallel access to noncontiguous regions of a file is essential to exploit high performance I/O as required by large-scale applications. Parallel I/O frameworks such as MPI I/O conceptually allow I/O to be defined on regions of a file using derived datatypes. Access to regions of a file can be automatically computed on a perprocessor basis using the datatype, resulting in a list of (offset, length) pairs. We describe three approaches for implementing lock serving (whole file, region locking, and byterange locking) and compare the various approaches using three noncontiguous I/O benchmarks. We present the details of the lock server architecture and describe the implementation of a fully-functional prototype that makes use of a lightweight message passing library and red/black trees.
A. Ching, P. M. Aarestad, A. N. Choudhary and G. K. Thiruvathukal, "Scalable Approaches for Supporting MPI-IO Atomicity," Cluster Computing and the Grid, IEEE International Symposium on(CCGRID), Singapore, 2006, pp. 35-42.