loading...
 This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Seventh IEEE International Symposium on Cluster Computing and the Grid (CCGrid '07)
Scheduling Data-IntensiveWorkflows onto Storage-Constrained Distributed Resources
Rio De Janeiro, Brazil
May 14-May 17
ISBN: 0-7695-2833-3
ASCII Text
x 
 
Arun Ramakrishnan, Gurmeet Singh, Henan Zhao, Ewa Deelman, Rizos Sakellariou, Karan Vahi, Kent Blackburn, David Meyers, Michael Samidi, "Scheduling Data-IntensiveWorkflows onto Storage-Constrained Distributed Resources," Cluster Computing and the Grid, IEEE International Symposium on, pp. 401-409, Seventh IEEE International Symposium on Cluster Computing and the Grid (CCGrid '07), 2007.
 
 
BibTex
x
 
@article{ 10.1109/CCGRID.2007.101,
author = {Arun Ramakrishnan and Gurmeet Singh and Henan Zhao and Ewa Deelman and Rizos Sakellariou and Karan Vahi and Kent Blackburn and David Meyers and Michael Samidi},
title = {Scheduling Data-IntensiveWorkflows onto Storage-Constrained Distributed Resources},
journal ={Cluster Computing and the Grid, IEEE International Symposium on},
volume = {0},
year = {2007},
isbn = {0-7695-2833-3},
pages = {401-409},
doi = {http://doi.ieeecomputersociety.org/10.1109/CCGRID.2007.101},
publisher = {IEEE Computer Society},
address = {Los Alamitos, CA, USA},
}
 
 
RefWorks Procite/RefMan/Endnote
x 
 
TY - CONF
JO - Cluster Computing and the Grid, IEEE International Symposium on
TI - Scheduling Data-IntensiveWorkflows onto Storage-Constrained Distributed Resources
SN - 0-7695-2833-3
SP401
EP409
A1 - Arun Ramakrishnan,
A1 - Gurmeet Singh,
A1 - Henan Zhao,
A1 - Ewa Deelman,
A1 - Rizos Sakellariou,
A1 - Karan Vahi,
A1 - Kent Blackburn,
A1 - David Meyers,
A1 - Michael Samidi,
PY - 2007
KW - null
VL - 0
JA - Cluster Computing and the Grid, IEEE International Symposium on
ER -
 
Arun Ramakrishnan, University of Southern California, Los Angeles, USA
Henan Zhao, University of Manchester, Manchester M13 9PL, UK
Rizos Sakellariou, University of Manchester, Manchester M13 9PL, UK
Kent Blackburn, California Institute of Technology
David Meyers, Northrop Grumman Information Technology, Pasadena
Michael Samidi, California Institute of Technology
In this paper we examine the issue of optimizing disk usage and of scheduling large-scale scientific workflows onto distributed resources where the workflows are dataintensive, requiring large amounts of data storage, and where the resources have limited storage resources. Our approach is two-fold: we minimize the amount of space a workflow requires during execution by removing data files at runtime when they are no longer required and we schedule the workflows in a way that assures that the amount of data required and generated by the workflow fits onto the individual resources. For a workflow used by gravitationalwave physicists, we were able to improve the amount of storage required by the workflow by up to 57 %. We also designed an algorithm that can not only find feasible solutions for workflow task assignment to resources in diskspace constrained environments, but can also improve the overall workflow performance.
Citation:
Arun Ramakrishnan, Gurmeet Singh, Henan Zhao, Ewa Deelman, Rizos Sakellariou, Karan Vahi, Kent Blackburn, David Meyers, Michael Samidi, "Scheduling Data-IntensiveWorkflows onto Storage-Constrained Distributed Resources," ccgrid, pp.401-409, Seventh IEEE International Symposium on Cluster Computing and the Grid (CCGrid '07), 2007
Usage of this product signifies your acceptance of the Terms of Use.