The Community for Technology Leaders
Green Image
Issue No. 09 - Sept. (2017 vol. 66)
ISSN: 0018-9340
pp: 1547-1561
Diomidis Spinellis , Department of Managment Science and Technology, Athens University of Economics and Business, Athens, Greece
Marios Fragkoulis , Department of Managment Science and Technology, Athens University of Economics and Business, Athens, Greece
ABSTRACT
The Unix shell dgsh provides an expressive way to construct sophisticated and efficient non-linear pipelines. Such pipelines can use standard Unix tools, as well as third-party and custom-built components. Dgsh allows the specification of pipelines that perform non-uniform non-linear processing. These form a directed acyclic process graph, which is typically executed by multiple processor cores, thus increasing the processing task’s throughput. A number of existing Unix tools have been adapted to take advantage of the new shell’s multiple pipe input/output capabilities. The shell supports visualization of the process graphs, which can also aid debugging. Dgsh was evaluated through a number of common data processing and domain-specific examples, and was found to offer an expressive way to specify processing topologies, while also generally increasing processing throughput.
INDEX TERMS
Pipelines, Syntactics, Standards, Throughput, Topology, Computer architecture, Parallel processing,Process-level parallelism, Unix, pipeline, pipes and filters architecture
CITATION
Diomidis Spinellis, Marios Fragkoulis, "Extending Unix Pipelines to DAGs", IEEE Transactions on Computers, vol. 66, no. , pp. 1547-1561, Sept. 2017, doi:10.1109/TC.2017.2695447
171 ms
(Ver 3.3 (11022016))