loading...
 This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Second International Symposium on Parallel and Distributed Computing
A Framework for Self-optimizing, Fault-tolerant, High Performance Bulk Data Transfers in a Heterogeneous Grid Environment
Ljubljana, Slovenia
October 13-October 14
ISBN: 0-7695-2069-3
Tevfik Kosar, University of Wisconsin-Madison
George Kola, University of Wisconsin-Madison
Miron Livny, University of Wisconsin-Madison
The drastic increase in the data requirements of scientific applications combined with an increasing trend towards collaborative research has resulted in the need to transfer large amounts of data among the participating sites. The general approach to transferring such large amounts of data has been to either dump data to tapes and mail them or employ scripts with an operator at each site to baby-sit the transfers to deal with failures. We introduce a framework which automates the whole process of data movement between different sites. The framework does not require any human intervention and it can recover automatically from various kinds of storage system, network, and software failures, guaranteeing completion of the transfers. The framework has sophisticated monitoring and tuning capability that increases the performance of the data transfers on the fly. The framework also generates on-the-fly visualization of the transfers making identification of problems and bottlenecks in the system simple.
Citation:
Tevfik Kosar, George Kola, Miron Livny, "A Framework for Self-optimizing, Fault-tolerant, High Performance Bulk Data Transfers in a Heterogeneous Grid Environment," ispdc, pp.137, Second International Symposium on Parallel and Distributed Computing, 2003
Usage of this product signifies your acceptance of the Terms of Use.