Issue No. 03 - May/June (2011 vol. 28)
DOI Bookmark: http://doi.ieeecomputersociety.org/10.1109/MS.2011.23
Ian Gorton , Pacific Northwest National Laboratory
Adam Wynne , Pacific Northwest National Laboratory
Yan Liu , Pacific Northwest National Laboratory
Jian Yin , Pacific Northwest National Laboratory
Scientists commonly describe their data-processing systems metaphorically as software pipelines. These pipelines input one or more data sources and apply steps to transform the data and create useful results. Although conceptually simple, pipelines often adopt complex topologies and must meet stringent quality-of-service requirements that stress the software infrastructure used to construct the pipeline. The Middleware for Data-Intensive Computing (MeDICi) Integration Framework (MIF) is a component-based framework for constructing complex software pipelines. It supports composing pipelines from distributed heterogeneous software components and provides mechanisms for controlling the quality of service to meet demanding performance, reliability, and communication requirements.
scientific software, pipelines, components, software engineering
Y. Liu, A. Wynne, J. Yin and I. Gorton, "Components in the Pipeline," in IEEE Software, vol. 28, no. , pp. 34-40, 2011.