Proceedings of the 1998 ACM/IEEE conference on Supercomputing
A Case for Using MPI's Derived Datatypes to Improve I/O Performance
Orlando, Florida
November 07-November 13
ISBN: 0-8186-8707-X
MPI-IO, the I/O part of the MPI-2 standard, is a promising new interface for parallel I/O. A key feature of MPI-IO is that it allows users to access several noncontiguous pieces of data from a file with a single I/O function call by defining file views with derived datatypes. We explain how critical this feature is for high performance, why users must create and use derived datatypes whenever possible, and how it enables implementations to perform optimizations. In particular, we describe two optimizations our MPI-IO implementation, ROMIO, performs: data sieving and collective I/O. We demonstrate the performance and portability of the approach with performance results on five different parallel machines: HP Exemplar, IBM SP, Intel Paragon, NEC SX-4, and SGI Origin2000.
Index Terms:
parallel I/O, MPI-IO
Citation:
Rajeev Thakur, William Gropp, Ewing Lusk, "A Case for Using MPI's Derived Datatypes to Improve I/O Performance," sc, pp.1, Proceedings of the 1998 ACM/IEEE conference on Supercomputing, 1998