The Community for Technology Leaders
Green Image
Issue No. 04 - April (2009 vol. 21)
ISSN: 1041-4347
pp: 595-608
Martin Rinard , Massachusetts Institute of Technology, Cambridge
Kian-Lee Tan , National University of Singapore, Singapore
Beng Chin Ooi , National University of Singapore, Singapore
Quang Hieu Vu , National University of Singapore, Singapore
ABSTRACT
Over the pass few years, peer-to-peer (P2P) systems have rapidly grown in popularity and become a dominant means for sharing resources. In these systems, load balancing is a key challenge because nodes are often heterogeneous. While several load balancing schemes have been proposed in the literature, these solutions are typically ad-hoc, heuristic-based and localized. In this paper, we present a general framework, HiGLOB, for global load balancing in structured P2P systems. Each node in HiGLOB has two key components: (1) A histogram manager maintains a histogram that reflects a global view of the distribution of the load in the system, and (2) A load-balancing manager that redistributes the load whenever the node becomes over or under loaded. We exploit the routing metadata to partition the P2P network into non-overlapping regions corresponding to the histogram buckets. We propose mechanisms to keep the cost of constructing and maintaining the histograms low. We further show that our scheme can control and bound the amount of load imbalance across the system. Finally, we demonstrate the effectiveness of HiGLOB by instantiating it over three existing structured P2P systems: Chord, Skip Graph and BATON. Our experimental results indicate that our approach works well in practice.
INDEX TERMS
Peer-to-Peer, Framework, Load Balancing, Histogram, DHT, Overlay Network
CITATION
Martin Rinard, Kian-Lee Tan, Beng Chin Ooi, Quang Hieu Vu, "Histogram-Based Global Load Balancing in Structured Peer-to-Peer Systems", IEEE Transactions on Knowledge & Data Engineering, vol. 21, no. , pp. 595-608, April 2009, doi:10.1109/TKDE.2008.182
88 ms
(Ver 3.1 (10032016))