The Community for Technology Leaders
2006 IEEE International Conference on Cluster Computing (2006)
Barcelona
Sept. 25, 2006 to Sept. 28, 2006
ISSN: 1552-5244
ISBN: 1-4244-0327-8
pp: 1-9
R.A. Oldfield , Sandia Nat. Labs., Albuquerque, NM
ABSTRACT
Efficient data movement is an important part of any high-performance I/O system, but it is especially critical for the current and next-generation of massively parallel processing (MPP) systems. In this paper, we discuss how the scale, architecture, and organization of current and proposed MPP systems impact the design of the data-movement scheme for the I/O system. We also describe and analyze the approach used by the lightweight file systems (LWFS) project, and we compare that approach to more conventional data-movement protocols used by small and mid-range clusters. Our results indicate that the data-movement strategy used by LWFS clearly outperforms conventional data-movement protocols, particularly as data sizes increase
INDEX TERMS
data-movement protocol, efficient data-movement, lightweight I/O, high-performance I/O system, massively parallel processing systems, lightweight file systems
CITATION

A. Maccabe, P. Widener, L. Ward, T. Kordenbrock and R. Oldfield, "Efficient Data-Movement for Lightweight I/O," 2006 IEEE International Conference on Cluster Computing(CLUSTER), Barcelona, 2006, pp. 1-9.
doi:10.1109/CLUSTR.2006.311897
88 ms
(Ver 3.3 (11022016))