loading...
 This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
22nd International Conference on Data Engineering Workshops (ICDEW'06)
Three Case Studies of Large-Scale Data Flows
Atlanta, Georgia
April 03-April 07
ISBN: 0-7695-2571-7
ASCII Text
x 
 
William Y. Arms, Selcuk Aya, Manuel Calimlim, Jim Cordes, Julia Deneva, Pavel Dmitriev, Johannes Gehrke2,4 Gehrke, Lawrence Gibbons, Christopher D. Jones, Valentin Kuznetsov, Dave Lifka, Mirek Riedewald, Dan Riley, Anders Ryd, Gregory J. Sharp, "Three Case Studies of Large-Scale Data Flows," Data Engineering Workshops, 22nd International Conference on, pp. 66, 22nd International Conference on Data Engineering Workshops (ICDEW'06), 2006.
 
 
BibTex
x
 
@article{ 10.1109/ICDEW.2006.148,
author = {William Y. Arms and Selcuk Aya and Manuel Calimlim and Jim Cordes and Julia Deneva and Pavel Dmitriev and Johannes Gehrke2,4 Gehrke and Lawrence Gibbons and Christopher D. Jones and Valentin Kuznetsov and Dave Lifka and Mirek Riedewald and Dan Riley and Anders Ryd and Gregory J. Sharp},
title = {Three Case Studies of Large-Scale Data Flows},
journal ={Data Engineering Workshops, 22nd International Conference on},
volume = {0},
year = {2006},
isbn = {0-7695-2571-7},
pages = {66},
doi = {http://doi.ieeecomputersociety.org/10.1109/ICDEW.2006.148},
publisher = {IEEE Computer Society},
address = {Los Alamitos, CA, USA},
}
 
 
RefWorks Procite/RefMan/Endnote
x 
 
TY - CONF
JO - Data Engineering Workshops, 22nd International Conference on
TI - Three Case Studies of Large-Scale Data Flows
SN - 0-7695-2571-7
SP
EP
A1 - William Y. Arms,
A1 - Selcuk Aya,
A1 - Manuel Calimlim,
A1 - Jim Cordes,
A1 - Julia Deneva,
A1 - Pavel Dmitriev,
A1 - Johannes Gehrke2,4 Gehrke,
A1 - Lawrence Gibbons,
A1 - Christopher D. Jones,
A1 - Valentin Kuznetsov,
A1 - Dave Lifka,
A1 - Mirek Riedewald,
A1 - Dan Riley,
A1 - Anders Ryd,
A1 - Gregory J. Sharp,
PY - 2006
KW - null
VL - 0
JA - Data Engineering Workshops, 22nd International Conference on
ER -
 
William Y. Arms, Cornell University
Selcuk Aya, Cornell University
Manuel Calimlim, Cornell University
Jim Cordes, Cornell University
Julia Deneva, Cornell University
Pavel Dmitriev, Cornell University
Johannes Gehrke2,4 Gehrke, Cornell University
Lawrence Gibbons, Cornell University
Christopher D. Jones, Cornell University
Valentin Kuznetsov, Cornell University
Dave Lifka, Cornell University
Mirek Riedewald, Cornell University
Dan Riley, Cornell University
Anders Ryd, Cornell University
Gregory J. Sharp, Cornell University
We survey three examples of large-scale scientific workflows that we are working with at Cornell: the Arecibo sky survey, the CLEO high-energy particle physics experiment, and the Web Lab project for enabling social science studies of the Internet. All three projects face the same general challenges: massive amounts of raw data, expensive processing steps, and the requirement to make raw data or data products available to users nation- or world-wide. However, there are several differences that prevent a one-sizefits- all approach to handling their data flows. Instead, current implementations are heavily tuned by domain and data management experts. We describe the three projects, and we outline research issues and opportunities to integrate Grid technology into these workflows.
Citation:
William Y. Arms, Selcuk Aya, Manuel Calimlim, Jim Cordes, Julia Deneva, Pavel Dmitriev, Johannes Gehrke2,4 Gehrke, Lawrence Gibbons, Christopher D. Jones, Valentin Kuznetsov, Dave Lifka, Mirek Riedewald, Dan Riley, Anders Ryd, Gregory J. Sharp, "Three Case Studies of Large-Scale Data Flows," icdew, pp.66, 22nd International Conference on Data Engineering Workshops (ICDEW'06), 2006
Usage of this product signifies your acceptance of the Terms of Use.