Oct. 14, 1996 to Oct. 16, 1996
M. Mitzenmacher , Dept. of Comput. Sci., California Univ., Berkeley, CA, USA
We provide a new approach for analyzing both static and dynamic randomized load balancing strategies. We demonstrate the approach by providing the first analysis of the following model: customers arrive as a Poisson stream of rate λn, λ < 1, at a collection of n servers. Each customer chooses some constant d servers independently and uniformly at random from the n servers, and waits for service at the one with the fewest customers. Customers are served according to the first-in first-out (FIFO) protocol, and the service time for a customer is exponentially distributed with mean 1. We call this problem the supermarket model. We wish to know how the system behaves, and in particular we are interested in the expected time a customer spends in the system in equilibrium. The model provides a good abstraction of a simple, efficient load balancing scheme in the setting where jobs arrive at a large system of parallel processors. This model appears more realistic than similar models studied previously, in that it is both dynamic and open: that is, customers arrive over time, and the number of customers is not fixed.
protocols; load balancing; density dependent jump Markov processes; dynamic randomized load balancing; Poisson stream; servers; first-in first-out protocol; service time; supermarket model; parallel processors
M. Mitzenmacher, "Load balancing and density dependent jump Markov processes", FOCS, 1996, 2013 IEEE 54th Annual Symposium on Foundations of Computer Science, 2013 IEEE 54th Annual Symposium on Foundations of Computer Science 1996, pp. 213, doi:10.1109/SFCS.1996.548480