The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.03 - March (2008 vol.20)
pp: 369-382
ABSTRACT
In a large-scale multimedia storage system (LMSS) where client requests for different multimedia objects may have different demands, placement and replication of the objects is an important factor, as it may result in an imbalance in server loading across the system. Since replica management and load balancing is all the more a crucial issue in multimedia systems, in the literature this problem is handled by centralized servers. Each object storage server (OSS) responses the requests coming from the centralized servers independently and has no communication with other OSSs among the system. In this paper, we design a novel distributed load balancing strategy of LMSS, in which the OSSs can cooperate together to achieve a high performance. Such OSS modeled as an M/M/m system, can replicate the objects to and balance the requests among other servers to achieve an optimal average waiting time (AWT) of the requests in the system. We validate the performance of the system via rigorous simulations with respect to several influencing factors and prove that our proposed strategy is scalable, flexible and efficient for the real-life applications.
INDEX TERMS
Multimedia storage system, load balancing, distributed system, average waiting time
CITATION
Zeng Zeng, Bharadwaj Veeravalli, "On the Design of Distributed Object Placement and Load Balancing Strategies in Large-Scale Networked Multimedia Storage Systems", IEEE Transactions on Knowledge & Data Engineering, vol.20, no. 3, pp. 369-382, March 2008, doi:10.1109/TKDE.2007.190694
REFERENCES
[1] B. Veeravalli and G. Barlas, Distributed Multimedia Retrieval Strategies for Large Scale Networked Systems. Springer-Verlag, 2005.
[2] C.Y. Choi and M. Hamdi, “A Scalable Video-on-Demand System Using Multi-Batch Buffering Techniques,” IEEE Trans. Broadcasting, vol. 49, no. 2, pp. 178-191, June 2003.
[3] W.K. Park, C.S. Choi, D.Y. Kim, Y.K. Jeong, and K.R. Park, “IPTV-Aware Multi-Service Home Gateway Based on FTTH Access Network,” Proc. Ninth Int'l Symp. Consumer Electronics (ISCE '05), pp. 285-290, June 2005.
[4] U. Jennehag and T. Zhang, “Increasing Bandwidth Utilization in Next Generation IPTV Networks,” Proc. Int'l Conf. Image Processing (ICIP '04), Oct. 2004.
[5] Y.J. Oyang, C.H. Wen, C.Y. Cheng, M.H. Lee, and J.T. Li, “A Multimedia Storage System for On-Demand Playback,” IEEE Trans. Consumer Electronics, vol. 41, no. 1, pp. 53-64, Feb. 1995.
[6] B. Ozden, R. Rastogi, and A. Silberschatz, “Buffer Replacement Algorithms for Multimedia Storage Systems,” Proc. Third IEEE Int'l Conf. Multimedia Computing and Systems (ICMCS '96), pp. 172-189, June 1996.
[7] K.C. Almeroth, “Adaptive Workload-Dependent Scheduling for Large-Scale Content Delivery Systems,” IEEE Trans. Circuits and Systems for Video Technology, vol. 11, no. 3, Mar. 2001.
[8] P. Braam, Luster, http:/www.lustre.org, 2005.
[9] S. Ghemawat, H. Gobioff, and S.T. Leung, “The Google File System,” Proc. 19th ACM Symp. Operating Systems Principles (SOSP '03), Oct. 2003.
[10] B. Nq, R.W.H. Lau, A. Si, and F.W.B. Li, “Multiserver Support for Large-Scale Distributed Virtual Environment,” IEEE Trans. Multimedia, vol. 7, no. 6, Dec. 2005.
[11] Z. Zeng and B. Veeravalli, “Design and Analysis of a Non-Preemptive Decentralized Load Balancing Algorithm for Multi-Class Jobs in Distributed Networks,” Computer Comm., vol. 27, pp.679-694, 2004.
[12] A.E. Kostin, I. Aybay, and G. Oz, “A Randomized Contention-Based Load-Balancing Protocol for a Distributed Multiserver Queuing System,” IEEE Trans. Parallel and Distributed Systems, vol. 11, no. 12, Dec. 2000.
[13] Y. Zhang, H. Franke, J. Moreira, and A. Sivasubramaniam, “An Integrated Approach to Parallel Scheduling Using Gang-Scheduling, Backfilling, and Migration,” IEEE Trans. Parallel and Distributed Systems, vol. 14, no. 3, pp. 236-247, Mar. 2003.
[14] E. Choi, “Performance Test and Analysis for an Adaptive Load Balancing Mechanism on Distributed Server Cluster Systems,” Future Generation Computer Systems, vol. 20, pp. 237-247, 2004.
[15] Tiger Shark File System, IBM Almaden, http://www.research. ibm.com/webvideo shark.html. , 2007.
[16] D.N. Serpanos, L. Georgiadis, and T. Boulouta, “MMpacking: A Load and Storage Balancing Algorithm for Distributed Multimedia Servers,” IEEE Trans. Circuits and Systems for Video Technology, vol. 8, no. 1, pp. 13-17, Feb. 1998.
[17] D. Bertsekas and R. Gallager, Data Networks. Prentice Hall, 1992.
[18] G. Zipf, Human Behavior and the Principle of Least Effort. Addison-Wesley, 1949.
[19] V. Almeida, A. Bestavros, M. Crovella, and A. de Oliveira, “Characterizing Reference Locality in the WWW,” Proc. Fourth IEEE Int'l Conf. Parallel and Distributed Information Systems (PDIS '96), Dec. 1996.
[20] K. Shen, T. Yang, and L. Chu, “Cluster Support and Replication Management for Scalable Network Services,” IEEE Trans. Parallel and Distributed Systems, vol. 14, no. 11, Nov. 2003.
[21] A. Bestavros, C.R. Cunha, and M.E. Crovella, “Characteristics of WWW Client-Based Traces,” technical report, Boston Univ., July 1995.
[22] N. Nishikawa, T. Hosokawa, Y. Mori, K. Yoshidab, and H. Tsujia, “Memory-Based Architecture with Distributed WWW Caching Proxy,” Proc. Seventh Int'l Conf World Wide Web (WWW '96), Apr. 1998.
[23] L. Jie and H. Kameda, “Load Balancing Problems for Multiclass Jobs in Distributed/Parallel Computer Systems,” IEEE Trans. Computers, vol. 47, no. 3, pp. 322-332, Mar. 1998.
[24] Z. Zeng and B. Veeravalli, “Design and Performance Evaluation of Queue-and-Rate-Adjustment Dynamic Load Balancing Policies for Distributed Networks,” IEEE Trans. Computers, vol. 55, no. 11, pp. 1410-1422, Nov. 2006.
[25] J.Y.B. Lee, “Channel Folding: An Algorithm to Improve Efficiency of Multicast Video-on-Demand Systems,” IEEE Trans. Multimedia, vol. 7, no. 2, pp. 366-378, Apr. 2005.
[26] B. Wu and A.D. Kshemkalyani, “Object-Optimal Algorithms for Long-Term Web Prefetching,” IEEE Trans. Computers, vol. 55, no. 1, pp. 2-17, Jan. 2006.
[27] L.F. Zeng, D. Feng, F. Wang, and K. Zhou, “Object Replication and Migration Policy Based on OSS,” Proc. Fourth Int'l Conf. Machine Learning and Cybernetics (ICMLC '05), Aug. 2005.
[28] J.J. Kinney, Probability: An Introduction with Statistical Applications. John Wiley & Sons, 1997.
[29] M. Avriel, Nonlinear Programming Analysis and Methods. Prentice Hall, 1997.
[30] D.P. Bertsekas, Nonlinear Programming. Athena Scientific, 1995.
[31] V.V. Mitin, D.A. Romanov, and M.P. Polis, Modern Advanced Mathematics for Engineers. John Wiley & Sons, 2001.
[32] S.D. Yao, C. Shahabi, and P.A. Larson, “Hash-Based Labeling Techniques for Storage Scaling,” The VLDB J.—The Int'l J. Very Large Data Bases, vol. 14, pp. 222-237, Apr. 2005.
[33] A.T. Stephanos and D. Spinellis, “A Survey of Peer-to-Peer Content Distribution Technologies,” ACM Computing Surveys, vol. 36, no. 4, pp. 335-371, Dec. 2004.
[34] Y. Lu, A. Zhang, H.F. He, and Z.Q. Deng, “Stochastic Fluid Model for P2P Content Distribution Networks,” Proc. Seventh Int'l Symp. Autonomous Decentralized Systems (ISADS '05), pp. 707-712, Apr. 2005.
[35] J.Y.B. Lee, “On a Unified Architecture for Video-on-Demand Services,” IEEE Trans. Multimedia, vol. 4, pp. 38-47, Mar. 2002.
[36] P. Hokstad, “Approximations for the M/G/m Queue,” Operations Research, vol. 26, no. 3, pp. 510-523, May/June 1978.
[37] Z.X. Zhao, S.S. Panwar, and D. Towsley, “Queuing Performance with Impatient Customers,” Proc. IEEE INFOCOM '91, pp. 400-409, Apr. 1991.
42 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool