The Community for Technology Leaders
RSS Icon
Subscribe
Pittsburgh, PA
Nov. 8, 2004 to Nov. 8, 2004
ISBN: 0-7695-2256-4
pp: 402-409
Ligang He , University of Warwick, UK
Stephen A. Jarvis , University of Warwick, UK
Daniel P. Spooner , University of Warwick, UK
Xinuo Chen , University of Warwick, UK
Graham R. Nudd , University of Warwick, UK
ABSTRACT
This paper addresses the dynamic scheduling of parallel jobs with QoS demands (soft-deadlines) in multi-clusters and grids. Three metrics (over-deadline, makespan and idle-time) are combined with variable weights to evaluate the scheduling performance. These three metrics are used to measure the extent of the jobs' QoS demand compliance, the resource throughput and the resource utilization. Two levels of performance optimisation are applied in the multicluster. At the multicluster level, a scheduler (which we call MUSCLE) allocates parallel jobs with high packing potential to the same cluster; it also takes the jobs' QoS requirements into account and employs a heuristic to allocate suitable workloads to each cluster to balance the overall system performance. At the single cluster level, an existing workload manager, called TITAN, utilizes a genetic algorithm to further improve the scheduling performance of the jobs previously allocated by MUSCLE. Extensive experimental studies are conducted to verify the effectiveness of the scheduling mechanism as well as the effect of the prediction accuracy on the scheduling performance. The results show that compared with traditional distributed workload allocation policies, the comprehensive scheduling performance of parallel jobs is significantly improved across the multicluster, and the presence of prediction errors does not dramatically weaken the performance advantage.
INDEX TERMS
null
CITATION
Ligang He, Stephen A. Jarvis, Daniel P. Spooner, Xinuo Chen, Graham R. Nudd, "Dynamic Scheduling of Parallel Jobs with QoS Demands in Multiclusters and Grids", GRID, 2004, Grid Computing, IEEE/ACM International Workshop on, Grid Computing, IEEE/ACM International Workshop on 2004, pp. 402-409, doi:10.1109/GRID.2004.27
6 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool