The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.10 - October (2010 vol.21)
pp: 1442-1457
Fangming Liu , Hong Kong University of Science and Technology, Hong Kong
Ye Sun , Hong Kong University of Science and Technology, Hong Kong
Bo Li , Hong Kong University of Science and Technology, Hong Kong
Baochun Li , University of Toronto, Toronto
Xinyan Zhang , Roxbeam Inc., Beijing
ABSTRACT
It has been widely acknowledged that online file hosting systems within the “cloud” of the Internet have provided valuable services to end users who wish to share files of any size. Such online hosting services are typically provided by dedicated servers, either in content distribution networks (CDNs) or large data centers. Server bandwidth costs, however, are prohibitive in these cases, especially when serving large volumes of files to a large number of users. Though it seems intuitive to take advantage of peer upload bandwidth to mitigate such server bandwidth costs in a complementary fashion, it is not trivial to design and fine-tune important aspects of such peer-assisted online hosting in a real-world large-scale deployment. This paper presents FS2You, a large-scale and real-world online file hosting system with peer assistance and semipersistent file availability. FS2You is designed to dramatically mitigate server bandwidth costs. In this paper, we show a number of key challenges involved in such a design objective, our architectural and protocol design in response to these challenges, as well as an extensive measurement study at a large scale to demonstrate the effectiveness of our design, using real-world traces that we have collected. To our knowledge, this paper represents the first attempt to design, implement, and evaluate a new peer-assisted semipersistent online file hosting system at a realistic scale. Since the launch of FS2You, it has quickly become one of the most popular online file hosting systems in mainland China, and a favorite in many online forums across the country.
INDEX TERMS
Online hosting, content distribution, peer-to-peer protocols, measurement studies.
CITATION
Fangming Liu, Ye Sun, Bo Li, Baochun Li, Xinyan Zhang, "FS2You: Peer-Assisted Semipersistent Online Hosting at a Large Scale", IEEE Transactions on Parallel & Distributed Systems, vol.21, no. 10, pp. 1442-1457, October 2010, doi:10.1109/TPDS.2010.28
REFERENCES
[1] B. Cohen, "Incentives Build Robustness in BitTorrent," Proc. Workshop Economics of Peer-to-Peer Systems, 2003.
[2] Rapidshare, http:/www.rapidshare.com, 2010.
[3] FS2You, http:/www.rayfile.com, 2010.
[4] Y. Sun, F. Liu, B. Li, B. Li, and X. Zhang, "FS2You: Peer-Assisted Semi-Persistent Online Storage at a Large Scale," Proc. IEEE INFOCOM, Apr. 2009.
[5] L. Guo, S. Chen, Z. Xiao, E. Tan, X. Ding, and X. Zhang, "Measurements, Analysis, and Modeling of BitTorrent-Like Systems," Proc. ACM Internet Measurement Conference (IMC), Oct. 2005.
[6] C. Wu, B. Li, and S. Zhao, "Multi-Channel Live P2P Streaming: Refocusing on Servers," Proc. IEEE INFOCOM, Apr. 2008.
[7] H. Yin, X. Liu, T. Zhan, V. Sekar, F. Qiu, C. Lin, H. Zhang, and B. Li, "Design and Deployment of a Hybrid CDN-P2P System for Live Video Streaming: Experiences with LiveSky," Proc. ACM Multimedia, Oct. 2009.
[8] Y. Huang, T. Fu, D. Chiu, J. Lui, and C. Huang, "Challenges, Design and Analysis of a Large-Scale P2P-VoD System," Proc. ACM SIGCOMM, Aug. 2008.
[9] C. Huang, A. Wang, J. Li, and K. Ross, "Understanding Hybrid CDN-P2P: Why Limelight Needs its Own Red Swoosh," Proc. ACM Int'l Workshop on Network and Operating Systems Support for Digital Audio and Video (ACM NOSSDAV), May 2008.
[10] D. Pakkala and J. Latvakoski, "Towards a Peer-to-Peer Extended Content Delivery Network," Proc. 14th IST Mobile & Wireless Comm. Summit, Dresden, Jun. 2005.
[11] D. Xu, S. Kulkarni, C. Rosenberg, and H. Chai, "Analysis of a CDN-P2P Hybrid Architecture for Cost-Effective Streaming Media Distribution," Multimedia Systems, vol. 11, no. 4, pp. 383-399, 2006.
[12] K. Gummadi, R. Dunn, S. Saroiu, S. Gribble, H. Levy, and J. Zahorjan, "Measurement, Modeling, and Analysis of a Peer-to-Peer File-Sharing Workload," Proc. ACM Symp. Operating Systems Principles, Oct. 2003.
[13] D. Stutzbach and R. Rejaie, "Understanding Churn in Peer-to-Peer Networks," Proc. ACM Internet Measurement Conference (IMC), Oct. 2006.
[14] D. Antoniades, E. Markatos, and C. Dovrolis, "One-Click Hosting Services: A File-Sharing Hideout," Proc. ACM Internet Measurement Conference (IMC), Nov. 2009.
[15] M. Cha, H. Kwak, P. Rodriguez, Y. Ahn, and S. Moon, "I Tube, You Tube, Everybody Tubes: Analyzing the World's Largest User Generated Content Video System," Proc. ACM Internet Measurement Conference (IMC), Oct. 2007.
[16] P. Gill, M. Arlitt, Z. Li, and A. Mahanti, "YouTube Traffic Characterization: A View from the Edge," Proc. ACM Internet Measurement Conference (IMC), Oct. 2007.
[17] B. Li, S. Xie, Y. Qu, Y. Keung, C. Lin, J. Liu, and X. Zhang, "Inside the New Coolstreaming: Principles, Measurements and Performance Implications," Proc. IEEE INFOCOM, Apr. 2008.
[18] B. Cheng, L. Stein, H. Jin, and Z. Zhang, "Towards Cinematic Internet Video-on-Demand," Proc. Third ACM SIGOPS/EuroSys European Conf. Computer Systems, Apr. 2008.
[19] L. Guo, E. Tan, S. Chen, Z. Xiao, and X. Zhang, "The Stretched Exponential Distribution of Internet Media Access Patterns," Proc. ACM Symp. Principles of Distributed Computing (PODC), Aug. 2008.
15 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool