16th Euromicro Conference on Parallel, Distributed and Network-Based Processing (PDP 2008) (2014)
Torino, Italy Italy
Feb. 12, 2014 to Feb. 14, 2014
DOI Bookmark: http://doi.ieeecomputersociety.org/10.1109/PDP.2014.46
Yuichi Tsujita , RIKEN AICS, Wako, Japan
Kazumi Yoshinaga , RIKEN AICS, Wako, Japan
Atsushi Hori , RIKEN AICS, Wako, Japan
Mikiko Sato , Tokyo Univ. of Agric. & Technol., Tokyo, Japan
Mitaro Namiki , Tokyo Univ. of Agric. & Technol., Tokyo, Japan
Yutaka Ishikawa , Univ. of Tokyo, Tokyo, Japan
ROMIO, a representative MPI-IO implementation, has been widely used in recent large-scale parallel computations. The two-phase I/O optimization scheme of ROMIO improves I/O performance for non-contiguous access patterns, however, this scheme still has room to improve performance to make it suitable for recent data-intensive computing. We propose overlapping data exchange operations with file I/O operations by using a multithreaded scheme to achieve further I/O throughput improvement. We show up to 60% improvement by the multithreaded two-phase I/O relative to the original two-phase I/O in performance evaluation of collective write operations on a Lustre file system of a Linux PC cluster.
Instruction sets, Throughput, Benchmark testing, Educational institutions, Libraries, Electronic mail, Performance evaluation
Y. Tsujita, K. Yoshinaga, A. Hori, M. Sato, M. Namiki and Y. Ishikawa, "Multithreaded Two-Phase I/O: Improving Collective MPI-IO Performance on a Lustre File System," 16th Euromicro Conference on Parallel, Distributed and Network-Based Processing (PDP 2008)(PDP), Torino, Italy Italy, 2014, pp. 232-235.