The Community for Technology Leaders
16th Euromicro Conference on Parallel, Distributed and Network-Based Processing (PDP 2008) (2014)
Torino, Italy Italy
Feb. 12, 2014 to Feb. 14, 2014
ISSN: 1066-6192
pp: 232-235
Yuichi Tsujita , RIKEN AICS, Wako, Japan
Kazumi Yoshinaga , RIKEN AICS, Wako, Japan
Atsushi Hori , RIKEN AICS, Wako, Japan
Mikiko Sato , Tokyo Univ. of Agric. & Technol., Tokyo, Japan
Mitaro Namiki , Tokyo Univ. of Agric. & Technol., Tokyo, Japan
Yutaka Ishikawa , Univ. of Tokyo, Tokyo, Japan
ABSTRACT
ROMIO, a representative MPI-IO implementation, has been widely used in recent large-scale parallel computations. The two-phase I/O optimization scheme of ROMIO improves I/O performance for non-contiguous access patterns, however, this scheme still has room to improve performance to make it suitable for recent data-intensive computing. We propose overlapping data exchange operations with file I/O operations by using a multithreaded scheme to achieve further I/O throughput improvement. We show up to 60% improvement by the multithreaded two-phase I/O relative to the original two-phase I/O in performance evaluation of collective write operations on a Lustre file system of a Linux PC cluster.
INDEX TERMS
Instruction sets, Throughput, Benchmark testing, Educational institutions, Libraries, Electronic mail, Performance evaluation
CITATION

Y. Tsujita, K. Yoshinaga, A. Hori, M. Sato, M. Namiki and Y. Ishikawa, "Multithreaded Two-Phase I/O: Improving Collective MPI-IO Performance on a Lustre File System," 16th Euromicro Conference on Parallel, Distributed and Network-Based Processing (PDP 2008)(PDP), Torino, Italy Italy, 2014, pp. 232-235.
doi:10.1109/PDP.2014.46
171 ms
(Ver 3.3 (11022016))