Issue No. 09 - Sept. (2017 vol. 66)
Diomidis Spinellis , Department of Managment Science and Technology, Athens University of Economics and Business, Athens, Greece
Marios Fragkoulis , Department of Managment Science and Technology, Athens University of Economics and Business, Athens, Greece
The Unix shell
dgsh provides an expressive way to construct sophisticated and efficient non-linear pipelines. Such pipelines can use standard Unix tools, as well as third-party and custom-built components. Dgsh allows the specification of pipelines that perform non-uniform non-linear processing. These form a directed acyclic process graph, which is typically executed by multiple processor cores, thus increasing the processing task’s throughput. A number of existing Unix tools have been adapted to take advantage of the new shell’s multiple pipe input/output capabilities. The shell supports visualization of the process graphs, which can also aid debugging. Dgsh was evaluated through a number of common data processing and domain-specific examples, and was found to offer an expressive way to specify processing topologies, while also generally increasing processing throughput.
Pipelines, Syntactics, Standards, Throughput, Topology, Computer architecture, Parallel processing,Process-level parallelism, Unix, pipeline, pipes and filters architecture
Diomidis Spinellis, Marios Fragkoulis, "Extending Unix Pipelines to DAGs", IEEE Transactions on Computers, vol. 66, no. , pp. 1547-1561, Sept. 2017, doi:10.1109/TC.2017.2695447