12th International Conference on Parallel and Distributed Systems - Volume 1 (ICPADS'06)
Memory and Network Bandwidth Aware Scheduling of Multiprogrammed Workloads on Clusters of SMPs
Minneapolis, Minnesota
July 12-July 15
ISBN: 0-7695-2612-8
Symmetric Multiprocessors (SMPs), combined with modern interconnection technologies are commonly used to build cost-effective compute clusters. However, contention among processors for access to shared resources, as is the main memory bus and the NIC can limit their efficiency significantly. In this paper, we first provide an experimental demonstration of the effect of resource contention on the total execution time of applications. Then, we present the design and implementation of an informed gang-like scheduling algorithm aimed at improving the throughput of multiprogrammed workloads on clusters of SMPs. Our algorithm selects the processes to be coscheduled so as not to saturate nor underutilize the memory bus or network link bandwidth. Its input data are acquired dynamically using hardware monitoring counters and a modified Myrinet NIC firmware, without any modifications to existing application binaries. Experimental evaluation shows throughput can improve up to 40-48% compared to the standard Linux 2.6 O(1) scheduler.
Index Terms:
scheduling, SMP clusters, multiprogramming, memory bandwidth, resource contention, performance counters, Linux, Myrinet
Citation:
Evangelos Koukis, Nectarios Koziris, "Memory and Network Bandwidth Aware Scheduling of Multiprogrammed Workloads on Clusters of SMPs," icpads, vol. 1, pp.345-354, 12th International Conference on Parallel and Distributed Systems - Volume 1 (ICPADS'06), 2006