The Community for Technology Leaders
SC Conference (2001)
Denver, Colorado
Nov. 10, 2001 to Nov. 16, 2001
ISBN: 1-58113-293-X
pp: 20
Bill Allcock , Argonne National Laboratory
Ian Foster , Argonne National Laboratory
Veronika Nefedova , Argonne National Laboratory
Ann Chervenak , University of Southern California
Ewa Deelman , University of Southern California
Carl Kesselman , University of Southern California
Jason Lee , Lawrence Berkeley National Laboratory
Alex Sim , Lawrence Berkeley National Laboratory
Arie Shoshani , Lawrence Berkeley National Laboratory
Bob Drach , Lawrence Livermore National Laboratory
Dean Williams , Lawrence Livermore National Laboratory
In numerous scientific disciplines, terabyte and soon petabyte-scale data collections are emerging as critical community resources. A new class of Data Grid infrastructure is required to support management, transport, distributed access to, and analysis of these datasets by potentially thousands of users. Researchers who face this challenge include the Climate Modeling community, which performs long-duration computations accompanied by frequent output of very large files that must be further analyzed. We describe the Earth System Grid prototype, which brings together advanced analysis, replica management, data transfer, request management, and other technologies to support high-performance, interactive analysis of replicated data. We present performance results that demonstrate our ability to manage the location and movement of large datasets from the user's desktop. We report on experiments conducted over SciNET at SC'2000, where we achieved peak performance of 1.55Gb/s and sustained performance of 512.9Mb/s for data transfers between Texas and California.

B. Drach et al., "High-Performance Remote Access to Climate Simulation Data: A Challenge Problem for Data Grid Technologies," SC Conference(SC), Denver, Colorado, 2001, pp. 20.
85 ms
(Ver 3.3 (11022016))