The Community for Technology Leaders
IEEE International Performance Computing and Communications Conference (2011)
Orlando, FL, USA
Nov. 17, 2011 to Nov. 19, 2011
ISBN: 978-1-4673-0010-0
pp: 1-8
Mengxia Zhu , Dept of Computer Science, Southern Illinois University, Carbondale, IL 62901
Stephen D. Miller , Neutron Science Scattering Division, Oak Ridge National Laboratory, Oak Ridge, TN 37831
Michael A. Reuter , Neutron Science Scattering Division, Oak Ridge National Laboratory, Oak Ridge, TN 37831
Patrick Brown , Dept of Computer Science, Southern Illinois University, Carbondale, IL 62901
Xukang Lu , Dept of Computer Science, University of Memphis, Memphis, TN 38152
Yi Gu , Dept of Management, Marketing, Computer Science, & Information Systems, University of Tennessee, Martin, TN 38238
Qishi Wu , Dept of Computer Science, University of Memphis, Memphis, TN 38152
ABSTRACT
Supporting large-scale scientific workflows in distributed network environments and optimizing their performances are crucial to the success of collaborative scientific discovery. We develop a generic scientific workflow platform, referred to as SciFlow, which constitutes a flexible framework to facilitate the distributed execution and management of scientific workflows and incorporates a class of workflow mapping schemes to achieve optimal end-to-end performances. The functionalities of SciFlow are provided and its interactions with other tools or systems are enabled through web services for easy access over standard Internet protocols while being independent of different platforms and programming languages. The performance superiority of SciFlow over existing workflow mapping schemes and management systems is illustrated by extensive simulations and is further verified by large-scale experiments on real-life scientific workflows through effective system implementation and deployment in distributed network environments.
INDEX TERMS
CITATION
Mengxia Zhu, Stephen D. Miller, Michael A. Reuter, Patrick Brown, Xukang Lu, Yi Gu, Qishi Wu, "A distributed workflow management system with case study of real-life scientific applications", IEEE International Performance Computing and Communications Conference, vol. 00, no. , pp. 1-8, 2011, doi:10.1109/PCCC.2011.6108109
181 ms
(Ver 3.3 (11022016))