2012 IEEE 8th International Conference on E-Science (2009)
Oxford, United Kingdom
Dec. 9, 2009 to Dec. 11, 2009
Workflow systems can manage complex scientific applications with distributed data processing. Although some workflow systems can represent collections of data with very compact abstractions and manage their execution efficiently, there are no approaches to date to manage collections of application components required to express some scientific applications. We present an approach to handle collections of components and data alike in expressive workflow templates whose basic structure is reusable. We also present an algorithm that can elaborate abstract compact workflow templates into execution-ready workflows that enumerate all computations to be carried out. We implemented the proposed approach in the Wings workflow system. Our work is motivated by real-world complex scientific applications that require handling of nested collections of both components and data.
Workflows, data collections, scientific data processing, computational experimentation
Varun Ratnakar, Christian Fritz, Yolanda Gil, Paul Groth, "Expressive Reusable Workflow Templates", 2012 IEEE 8th International Conference on E-Science, vol. 00, no. , pp. 344-351, 2009, doi:10.1109/e-Science.2009.55