The Community for Technology Leaders
IEEE International Performance Computing and Communications Conference (2011)
Orlando, FL, USA
Nov. 17, 2011 to Nov. 19, 2011
ISBN: 978-1-4673-0010-0
pp: 1-8
Qishi Wu , Dept of Computer Science, University of Memphis, Memphis, TN 38152
Mengxia Zhu , Dept of Computer Science, Southern Illinois University, Carbondale, IL 62901
Yi Gu , Dept of Management, Marketing, Computer Science, & Information Systems, University of Tennessee, Martin, TN 38238
Xukang Lu , Dept of Computer Science, University of Memphis, Memphis, TN 38152
Patrick Brown , Dept of Computer Science, Southern Illinois University, Carbondale, IL 62901
Michael A. Reuter , Neutron Science Scattering Division, Oak Ridge National Laboratory, Oak Ridge, TN 37831
Stephen D. Miller , Neutron Science Scattering Division, Oak Ridge National Laboratory, Oak Ridge, TN 37831
ABSTRACT
Supporting large-scale scientific workflows in distributed network environments and optimizing their performances are crucial to the success of collaborative scientific discovery. We develop a generic scientific workflow platform, referred to as SciFlow, which constitutes a flexible framework to facilitate the distributed execution and management of scientific workflows and incorporates a class of workflow mapping schemes to achieve optimal end-to-end performances. The functionalities of SciFlow are provided and its interactions with other tools or systems are enabled through web services for easy access over standard Internet protocols while being independent of different platforms and programming languages. The performance superiority of SciFlow over existing workflow mapping schemes and management systems is illustrated by extensive simulations and is further verified by large-scale experiments on real-life scientific workflows through effective system implementation and deployment in distributed network environments.
INDEX TERMS
CITATION
Qishi Wu, Mengxia Zhu, Yi Gu, Xukang Lu, Patrick Brown, Michael A. Reuter, Stephen D. Miller, "A distributed workflow management system with case study of real-life scientific applications", IEEE International Performance Computing and Communications Conference, vol. 00, no. , pp. 1-8, 2011, doi:10.1109/PCCC.2011.6108109
155 ms
(Ver 3.3 (11022016))