SC Conference (2001)
Nov. 10, 2001 to Nov. 16, 2001
DOI Bookmark: http://doi.ieeecomputersociety.org/10.1109/SC.2001.10023
Douglas Thain , University of Wisconsin - Madison
John Bent , University of Wisconsin - Madison
Andrea Arpaci-Dusseau , University of Wisconsin - Madison
Remzi Arpaci-Dusseau , University of Wisconsin - Madison
Miron Livny , University of Wisconsin - Madison
Grid applications have demanding I/O needs. Schedulers must bring jobs and data in close proximity in order to satisfy throughput, scalability, and policy requirements. Most systems accomplish this by making either jobs or data mobile. We propose a system that allows jobs and data to meet by binding execution and storage sites together into I/O communities which then participate in the wide-area system. The relationships between participants in a community may be expressed by the ClassAd framework. Extensions to the framework allow community members to express indirect relations. We demonstrate our implementation of I/O communities by improving the performance of a key high-energy physics simulation on an international distributed system.
A. Arpaci-Dusseau, J. Bent, R. Arpaci-Dusseau, M. Livny and D. Thain, "Gathering at the Well: Creating Communities for Grid I/O," SC Conference(SC), Denver, Colorado, 2001, pp. 21.