2006 IEEE International Conference on Cluster Computing (2006)
Sept. 25, 2006 to Sept. 28, 2006
R.A. Oldfield , Sandia Nat. Labs., Albuquerque, NM
Efficient data movement is an important part of any high-performance I/O system, but it is especially critical for the current and next-generation of massively parallel processing (MPP) systems. In this paper, we discuss how the scale, architecture, and organization of current and proposed MPP systems impact the design of the data-movement scheme for the I/O system. We also describe and analyze the approach used by the lightweight file systems (LWFS) project, and we compare that approach to more conventional data-movement protocols used by small and mid-range clusters. Our results indicate that the data-movement strategy used by LWFS clearly outperforms conventional data-movement protocols, particularly as data sizes increase
data-movement protocol, efficient data-movement, lightweight I/O, high-performance I/O system, massively parallel processing systems, lightweight file systems
A. Maccabe, P. Widener, L. Ward, T. Kordenbrock and R. Oldfield, "Efficient Data-Movement for Lightweight I/O," 2006 IEEE International Conference on Cluster Computing(CLUSTER), Barcelona, 2006, pp. 1-9.