The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.07 - July (2011 vol.22)
pp: 1164-1177
Chao Zhang , Polytechnic Institute of NYU, Brooklyn
Prithula Dhungel , Polytechnic Institute of NYU, Brooklyn
Di Wu , Sun Yat-Sen University, Guangzhou
Keith W. Ross , Polytechnic Institute of NYU, Brooklyn
ABSTRACT
BitTorrent is the most successful open Internet application for content distribution. Despite its importance, both in terms of its footprint in the Internet and the influence it has on emerging P2P applications, the BitTorrent Ecosystem is only partially understood. We seek to provide a nearly complete picture of the entire public BitTorrent Ecosystem. To this end, we crawl five of the most popular torrent-discovery sites over a ine-month period, identifying all of 4.6 million and 38,996 trackers that the sites reference. We also develop a high-performance tracker crawler, and over a narrow window of 12 hours, crawl essentially all of the public Ecosystem's trackers, obtaining peer lists for all referenced torrents. Complementing the torrent-discovery site and tracker crawling, we further crawl Azureus and Mainline DHTs for a random sample of torrents. Our resulting measurement data are more than an order of magnitude larger (in terms of number of torrents, trackers, or peers) than any earlier study. Using this extensive data set, we study in-depth the Ecosystem's torrent-discovery, tracker, peer, user behavior, and content landscapes. For peer statistics, the analysis is based on one typical snapshot obtained over 12 hours. We further analyze the fragility of the Ecosystem upon the removal of its most important tracker service.
INDEX TERMS
BitTorrent Ecosystem, peer-to-peer, content distribution, measurement.
CITATION
Chao Zhang, Prithula Dhungel, Di Wu, Keith W. Ross, "Unraveling the BitTorrent Ecosystem", IEEE Transactions on Parallel & Distributed Systems, vol.22, no. 7, pp. 1164-1177, July 2011, doi:10.1109/TPDS.2010.123
REFERENCES
[1] "Mininova's Torrent Downloads Double to 7 Billion in a Year," http://torrentfreak.commininovas-torrent-downloads-doubled-in-a-year-090105 , 2010.
[2] "BitTorrent Clients," http://en.wikipedia.org/wikiBitTorrent_ client , 2010.
[3] "BitTorrent Trackers," http://en.wikipedia.org/wikiBitTorrent_ tracker , 2010.
[4] X. Hei, C. Liang, J. Liang, Y. Liu, and K.W. Ross, "A Measurement Study of a Large-Scale P2P IPTV System," IEEE Trans. Multimedia, vol. 9, no. 8, pp. 1672-1687, Dec. 2007.
[5] Y. Huang, T.Z. Fu, D. Chiu, J.C. Lui, and C. Huang, "Challenges, Design and Analysis of a Large-Scale P2P VoD Systems," Proc. ACM SIGCOMM, 2008.
[6] J.A. Pouwelse, P. Garbacki, D.H. Epema, and H. Sips, "The BitTorrent P2P File-Sharing System: Measurements and Analysis," Proc. Int'l Workshop Peer-to-Peer Systems (IPTPS), Feb. 2005.
[7] L. Guo, S. Chen, Z. Xiao, E. Tan, X. Ding, and X. Zhang, "Measurements, Analysis, and Modeling of BitTorrent-Like Systems," Proc. Internet Measurement Conf., Oct. 2005.
[8] G. Neglia, G. Reina, H. Zhang, D. Towsley, A. Venkataramani, and J. Danaher, "Availability in BitTorrent Systems," Proc. IEEE INFOCOM, 2007.
[9] "Alexa Web Site," http:/www.alexa.com, 2010.
[10] G.I. Ivchenko, "How Many Samples Does it Take to See All the Balls in an Urn?" Math. Notes, vol. 64, no. 1, pp. 58-63, July 1998.
[11] "Slyck Forum."
[12] "MovieX Site," http:/www.moviex.info, 2010.
[13] "MaxMind GeoIP," http://www.maxmind.com/appgeoip_ country , 2010.
[14] "The Pirate Bay," http:/thepiratebay.org, 2010.
[15] M. Cha, H. Kwak, P. Rodriguez, Y.-Y. Ahn, and S. Moon, "I Tube, You Tube, Everybody Tubes: Analyzing the World's Largest User Generated Content Video System," Proc. ACM SIGCOMM/USENIX Internet Measurement Conf. (IMC), 2007.
[16] "World Internet Users and Population Stats," http://www. internetworldstats.comstats.htm , 2010.
[17] B. Cohen, "Incentives Build Robustness in BitTorrent," Proc. First Workshop Economics of Peer-to-Peer Systems (P2PEcon), June 2003.
[18] B. Fan, D.-M. Chiu, and J.C.S. Lui, "The Delicate Tradeoffs in BitTorrent-Like File Sharing Protocol Design," Proc. 14th IEEE Int'l Conf. Network Protocols (ICNP), 2006.
[19] M. Izal, G. Urvoy-Keller, E. Biersack, P. Felber, A. Hamra, and L. Garces-Erice, "Dissecting BitTorrent: Five Months in a Torrent's Lifetime," Proc. Fifth Int'l Workshop Passive and Active Measurement, Apr. 2004.
[20] T. Karagiannis, A. Broido, N. Brownlee, K.C. Claffy, and M. Faloutsos, "Is P2P Dying or Just Hiding?" Proc. IEEE Int'l Global Comm. Conf. (GLOBECOM), 2004.
[21] A. Legout, G. Urvoy-Keller, and P. Michiardi, "Rarest First and Choke Algorithms are Enough," Proc. ACM SIGCOMM/USENIX Internet Measurement Conf. (IMC), 2006.
[22] N. Liogkas, R. Nelson, E. Kohler, and L. Zhang, "Exploring the Robustness of BitTorrent Peer-to-Peer Content Distribution Systems," Concurrency and Computation: Practice and Experience, vol. 20, pp. 179-189, 2007.
[23] T. Locher, P. Moor, S. Schmid, and R. Wattenhofer1, "Free Riding in BitTorrent is Cheap," Proc. ACM Workshop Hot Topics in Networks (HotNets), 2006.
[24] S. Jun and M. Ahamad, "Incentives in BitTorrent Induce Free Riding," Proc. ACM SIGCOMM Workshop Economics of Peer-to-Peer Systems (P2PEcon), Aug. 2005.
[25] M. Piatek, T. Isdal, T. Anderson, A. Krishnamurthy, and A. Venkataramani, "Do Incentives Build Robustness in BitTorrent?" Proc. USENIX Symp. Networked Systems Design and Implementation (NSDI), Apr. 2007.
[26] M. Sirivianos, J.H. Park, R. Chen, and X. Yang, "Free-Riding in BitTorrent Networks with the Large View Exploit," Proc. Sixth Int'l Workshop Peer-to-Peer Systems (IPTPS), Feb. 2007.
[27] A. Legout, N. Liogkas, E. Kohler, and L. Zhang, "Clustering and Sharing Incentives in BitTorrent Systems," Proc. ACM SIGMETRICS, June 2007.
[28] N. Laoutari, D. Carra, and P. Michiardi, "Uplink Allocation Beyond Choke/Unchoke or How to Divide and Conquer Best," Proc. ACM Int'l Conf. Emerging Networking Experiments and Technologies (CoNEXT), Dec. 2008.
[29] A. Bellissimo, B.N. Levine, and P. Shenoy, "Exploring the Use of BitTorrent as the Basis for a Large Trace Repository," Technical Report 04-41, UMASS Amherst, June 2004.
[30] L. Guo, S. Chen, Z. Xiao, E. Tan, X. Ding, and X. Zhang, "A Performance Study of BitTorrent-Like Peer-To-Peer Systems," IEEE J. Selected Areas in Comm., vol. 25, no. 1, pp. 155-169, Jan. 2007.
31 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool