The Community for Technology Leaders
Parallel and Distributed Systems, International Conference on (2006)
Minneapolis, Minnesota
July 12, 2006 to July 15, 2006
ISSN: 1521-9097
ISBN: 0-7695-2612-8
pp: 123-134
William M. Jones , Clemson University, USA
Walter B. Ligon III , Clemson University, USA
Nishant Shrivastava , Clemson University, USA
ABSTRACT
In this paper, we utilize a bandwidth-centric job communication model that captures the interaction and impact of simultaneously co-allocating jobs across multiple clusters. We make use of a parallel job model that seeks to capture both local and global communication access patterns. By doing so, we are able to explore scheduling strategies that attempt to improve average job turnaround time by selectively mapping jobs across cluster boundaries in a process known as job co-allocation. <p>In this research, we focus on scheduling strategies that make use of available information such as network link utilization, per-processor bandwidths, and job communication topology in order to make intelligent decisions regarding application partition sizes and job placement. We provide results that help to establish the relationship between the quantity of information available a priori to the scheduler and its ability to improve overall system performance. Additionally, we demonstrate the dramatic impact that salient workload characteristics can have on the effectiveness of co-allocation.</p>
INDEX TERMS
parallel job scheduling, multiple computational clusters, workload effects, network contention, multisite scheduling
CITATION

W. M. Jones, N. Shrivastava and W. B. Ligon III, "The Impact of Information Availability and Workload Characteristics on the Performance of Job Co-allocation in Multi-clusters," 12th International Conference on Parallel and Distributed Systems(ICPADS), Minneapolis, MN, 2006, pp. 123-134.
doi:10.1109/ICPADS.2006.105
83 ms
(Ver 3.3 (11022016))