The Community for Technology Leaders
Green Image
Issue No. 02 - February (2009 vol. 20)
ISSN: 1045-9219
pp: 207-218
Rob van der Mei , CWI-Mathematics and Computer Science, Kruislaan
Ger Koole , Vrije Universitiet, Amsterdam
Menno Dobber , Vrije Universitiet, Amsterdam
Global-scale grids provide a massive source of processing power, providing the means to support processor intensive parallel applications. The strong burstiness and unpredictability of the available processing and network resources raise the strong need to make applications robust against the dynamics of grid environments. The two main techniques that are most suitable to cope with the dynamic nature of the grid are Dynamic Load Balancing (DLB) and job replication (JR). In this paper, we analyze and compare the effectiveness of these two approaches by means of trace-driven simulations. We observe that there exists an easy-to-measure statistic Y and a corresponding threshold value Y^{\ast}, such that DLB consistently outperforms JR when Y > Y^{\ast}, whereas the reverse is true for Y < Y^{\ast}. Based on this observation, we propose a simple and easy-to-implement approach, throughout referred to as the DLB/JR method, that can make dynamic decisions about whether to use DLB or JR. Extensive simulations based on a large set of real data monitored in a global-scale grid show that our DLB/JR method consistently performs at least as good as both DLB and JR in all circumstances, which makes our DLB/JR method highly robust against the unpredictable nature of global-scale grids.
Grid computing, dynamic load balancing, job replication, performance.
Rob van der Mei, Ger Koole, Menno Dobber, "Dynamic Load Balancing and Job Replication in a Global-Scale Grid Environment: A Comparison", IEEE Transactions on Parallel & Distributed Systems, vol. 20, no. , pp. 207-218, February 2009, doi:10.1109/TPDS.2008.61
93 ms
(Ver 3.1 (10032016))