Issue No. 09 - Sept. (2017 vol. 66)
Diomidis Spinellis , Department of Managment Science and Technology, Athens University of Economics and Business, Athens, Greece
Marios Fragkoulis , Department of Managment Science and Technology, Athens University of Economics and Business, Athens, Greece
The Unix shell
dgsh provides an expressive way to construct sophisticated and efficient non-linear pipelines. Such pipelines can use standard Unix tools, as well as third-party and custom-built components. Dgsh allows the specification of pipelines that perform non-uniform non-linear processing. These form a directed acyclic process graph, which is typically executed by multiple processor cores, thus increasing the processing task’s throughput. A number of existing Unix tools have been adapted to take advantage of the new shell’s multiple pipe input/output capabilities. The shell supports visualization of the process graphs, which can also aid debugging. Dgsh was evaluated through a number of common data processing and domain-specific examples, and was found to offer an expressive way to specify processing topologies, while also generally increasing processing throughput.
Pipelines, Syntactics, Standards, Throughput, Topology, Computer architecture, Parallel processing
Diomidis Spinellis, Marios Fragkoulis, "Extending Unix Pipelines to DAGs", IEEE Transactions on Computers, vol. 66, no. , pp. 1547-1561, Sept. 2017, doi:10.1109/TC.2017.2695447