Subscribe
Denver, Colorado
Nov. 10, 2001 to Nov. 16, 2001
ISBN: 1-58113-293-X
pp: 21
John Bent , University of Wisconsin - Madison
Andrea Arpaci-Dusseau , University of Wisconsin - Madison
Remzi Arpaci-Dusseau , University of Wisconsin - Madison
Douglas Thain , University of Wisconsin - Madison
ABSTRACT
Grid applications have demanding I/O needs. Schedulers must bring jobs and data in close proximity in order to satisfy throughput, scalability, and policy requirements. Most systems accomplish this by making either jobs or data mobile. We propose a system that allows jobs and data to meet by binding execution and storage sites together into I/O communities which then participate in the wide-area system. The relationships between participants in a community may be expressed by the ClassAd framework. Extensions to the framework allow community members to express indirect relations. We demonstrate our implementation of I/O communities by improving the performance of a key high-energy physics simulation on an international distributed system.
CITATION
John Bent, Andrea Arpaci-Dusseau, Remzi Arpaci-Dusseau, Douglas Thain, "Gathering at the Well: Creating Communities for Grid I/O", SC, 2001, SC Conference, SC Conference 2001, pp. 21, doi:10.1109/SC.2001.10023