The Community for Technology Leaders
Green Image
Issue No. 01 - Jan.-March (2012 vol. 5)
ISSN: 1939-1374
pp: 45-58
Shiyong Lu , Wayne State University, Detroit
Xubo Fei , Wayne State University, Detroit
ABSTRACT
Scientific workflow has recently become an enabling technology to automate and speed up the scientific discovery process. Although several scientific workflow management systems (SWFMSs) have been developed, a formal scientific workflow composition model in which workflow constructs are fully compositional one with another is still missing. In this paper, we propose a dataflow-based scientific workflow composition framework consisting of 1) a dataflow-based scientific workflow model that separates the declaration of the workflow interface from the definition of its functional body; 2) a set of workflow constructs, including Map, Reduce, Tree, Loop, Conditional, and Curry, which are fully compositional one with another; 3) a dataflow-based exception handling approach to support hierarchical exception propagation and user-defined exception handling. Our workflow composition framework is unique in that workflows are the only operands for composition; in this way, our approach elegantly solves the two-world problem in existing composition frameworks, in which composition needs to deal with both the world of tasks and the world of workflows. The proposed framework is implemented and several case studies are conducted to validate our techniques.
INDEX TERMS
Scientific workflow, scientific workflow model, workflow composition, MapReduce, VIEW.
CITATION
Shiyong Lu, Xubo Fei, "A Dataflow-Based Scientific Workflow Composition Framework", IEEE Transactions on Services Computing, vol. 5, no. , pp. 45-58, Jan.-March 2012, doi:10.1109/TSC.2010.58
126 ms
(Ver )