Issue No.03 - May/June (2011 vol.28)
Adam Wynne , Pacific Northwest National Laboratory
Yan Liu , Pacific Northwest National Laboratory
Ian Gorton , Pacific Northwest National Laboratory
DOI Bookmark: http://doi.ieeecomputersociety.org/10.1109/MS.2011.23
Scientists commonly describe their data-processing systems metaphorically as software pipelines. These pipelines input one or more data sources and apply steps to transform the data and create useful results. Although conceptually simple, pipelines often adopt complex topologies and must meet stringent quality-of-service requirements that stress the software infrastructure used to construct the pipeline. The Middleware for Data-Intensive Computing (MeDICi) Integration Framework (MIF) is a component-based framework for constructing complex software pipelines. It supports composing pipelines from distributed heterogeneous software components and provides mechanisms for controlling the quality of service to meet demanding performance, reliability, and communication requirements.
scientific software, pipelines, components, software engineering
Adam Wynne, Yan Liu, Ian Gorton, "Components in the Pipeline", IEEE Software, vol.28, no. 3, pp. 34-40, May/June 2011, doi:10.1109/MS.2011.23