Dec. 1, 2003 to Dec. 4, 2003
Florin Isaila , University of Karlsruhe
Walter F. Tichy , University of Karlsruhe
This paper presents view I/O, a non-contiguous parallel I/O technique. We show that the linear file model may be an unsuitable abstraction for non-contiguous I/O optimizations. Additionally, the poor cooperation between a file system and an I/O library like MPI-IO may drastically affect the performance. View I/O has detailed knowledge about parallel structure of a file and about the potential access pattern and exploits it in order to improve performance. The access overhead is reduced by using a strategy "declare once, use several times" and by file off-set compaction. We compare and contrast view I/O with other non-contiguous I/O methods. Our measurements on a cluster of computers indicate a significant performance improvement over other approaches.
Florin Isaila, Walter F. Tichy, "View I/O: Improving the Performance of Non-Contiguous I/O", CLUSTER, 2003, 2013 IEEE International Conference on Cluster Computing (CLUSTER), 2013 IEEE International Conference on Cluster Computing (CLUSTER) 2003, pp. 336, doi:10.1109/CLUSTR.2003.1253332