The Community for Technology Leaders
RSS Icon
Issue No.06 - June (2008 vol.19)
pp: 837-850
We consider using tools like traceroute to infer the underlay topology among a group of hosts. Traditional Max-Delta inference relies on a central server and is not scalable. In this paper, we investigate a distributed inference scheme to support scalable inference. In our scheme, each host joins an overlay tree before conducting traceroute. A host then independently selects paths to traceroute and exchanges traceroute results with others through the overlay tree. As a result, each host can maintain a partially discovered topology. Furthermore, we propose several techniques to reduce the measurement cost, including (a) integrating the Doubletree algorithm to reduce measurement redundancy; (b) setting up a lookup table for routers to reduce traceroute size, and (c) conducting topology abstraction and reducing the computing frequency to reduce computational overhead. In our scheme, the computation loads for target selection are distributed to all the hosts instead of a single server, and the consumption of edge bandwidth at a host is hence limited. We have done simulations on Internet-like topologies and conducted measurements on PlanetLab. The results show that the constructed tree has a low diameter. Furthermore, the proposed improvements can efficiently reduce measurement redundancy, computational overhead and bandwidth consumption.
Network topology, Network monitoring, Internet Applications
Xing Jin, Wanqing Tu, S.-H. Gary Chan, "Scalable and Efficient End-to-End Network Topology Inference", IEEE Transactions on Parallel & Distributed Systems, vol.19, no. 6, pp. 837-850, June 2008, doi:10.1109/TPDS.2007.70771
[1] D.G. Andersen, H. Balakrishnan, M.F. Kaashoek, and R. Morris, “Resilient Overlay Networks,” Proc. 18th ACM Symp. Operating Systems Principles (SOSP '01), pp. 131-145, Oct. 2001.
[2] Y.H. Chu, S. Rao, S. Seshan, and H. Zhang, “A Case for End System Multicast,” IEEE J. Selected Areas in Comm., vol. 20, no. 8, pp. 1456-1471, Oct. 2002.
[3] S. Banerjee, B. Bhattacharjee, and C. Kommareddy, “Scalable Application Layer Multicast,” Proc. ACM SIGCOMM '02, pp. 205-217, Aug. 2002.
[4] S. Rhea, B. Godfrey, B. Karp, J. Kubiatowicz, S. Ratnasamy, S. Shenker, I. Stoica, and H. Yu, “OpenDHT: A Public DHT Service and Its Uses,” Proc. ACM SIGCOMM '05, pp. 73-84, Aug. 2005.
[5] Y. Chawathe, S. Ramabhadran, S. Ratnasamy, A. LaMarca, J. Hellerstein, and S. Shenker, “A Case Study in Building Layered DHT Applications,” Proc. ACM SIGCOMM '05, pp.97-108, Aug. 2005.
[6] D.G. Andersen, N. Feamster, S. Bauer, and H. Balakrishnan, “Topology Inference from BGP Routing Dynamics,” Proc. ACM Internet Measurement Workshop (IMW '02), pp. 243-248, Nov. 2002.
[7] F. Wang and L. Gao, “On Inferring and Characterizing Internet Routing Policies,” Proc. ACM Internet Measurement Workshop (IMW'03), pp. 15-26, Oct. 2003.
[8] M. Coates, R. Castro, R. Nowak, M. Gadhiok, R. King, and Y. Tsang, “Maximum Likelihood Network Topology Identification from Edge-Based Unicast Measurements,” Proc. ACM SIGMETRICS '02, pp. 11-20, 2002.
[9] M. Coates, A. Hero, R. Nowak, and B. Yu, “Internet Tomography,” IEEE Signal Processing Magazine, vol. 19, no. 3, pp. 47-65, May 2002.
[10] Traceroute, http:/, 2007.
[11] M. Kwon and S. Fahmy, “Topology-Aware Overlay Networks for Group Communication,” Proc. 12th ACM Int'l Workshop Network and Operating Systems Support for Digital Audio and Video (NOSSDAV '02), pp. 127-136, May 2002.
[12] J. Han, D. Watson, and F. Jahanian, “Topology Aware Overlay Networks,” Proc. IEEE INFOCOM '05, pp. 2554-2565, Mar. 2005.
[13] X. Jin, Y. Wang, and S.-H.G. Chan, “Fast Overlay Tree Based on Efficient End-to-End Measurements,” Proc. IEEE Int'l Conf. Comm. (ICC '05), pp. 1319-1323, May 2005.
[14] X. Jin, Q. Xia, and S.-H.G. Chan, “A Cost-Based Evaluation of End-to-End Network Measurements in Overlay Multicast,” Proc. IEEE INFOCOM Mini-Symposium '07, June 2007.
[15] X. Jin, W.-P.K. Yiu, S.-H.G. Chan, and Y. Wang, “Network Topology Inference Based on End-to-End Measurements,” IEEE J.Selected Areas in Comm., vol. 24, no. 12, pp. 2182-2195, Dec. 2006.
[16] S.Y. Shi, J.S. Turner, and M. Waldvogel, “Dimensioning Server Access Bandwidth and Multicast Routing in Overlay Networks,” Proc. 11th ACM Int'l Workshop Network and Operating Systems Support for Digital Audio and Video (NOSSDAV '01), pp. 83-91, 2001.
[17] S.Y. Shi and J.S. Turner, “Routing in Overlay Multicast Networks,” Proc. IEEE INFOCOM '02, pp. 1200-1208, June 2002.
[18] B. Donnet, T. Friedman, and M. Crovella, “Improved Algorithms for Network Topology Discovery,” Proc. Sixth Int'l Workshop Passive and Active Network Measurement (PAM '05), Mar. 2005.
[19] B. Donnet, P. Raoult, T. Friedman, and M. Crovella, “Efficient Algorithms for Large-Scale Topology Discovery,” Proc. ACM SIGMETRICS '05, pp. 327-338, June 2005.
[20] B. Donnet, P. Raoult, T. Friedman, and M. Crovella, “Deployment of an Algorithm for Large-Scale Topology Discovery,” IEEE J.Selected Areas in Comm., vol. 24, no. 12, pp. 2210-2220, Dec. 2006.
[21] Skitter, /, 2007.
[22] R. Govindan and H. Tangmunarunkit, “Heuristics for Internet Map Discovery,” Proc. IEEE INFOCOM '00, pp. 1371-1380, Mar. 2000.
[23] N. Spring, R. Mahajan, and D. Wetherall, “Measuring ISP Topologies with Rocketfuel,” Proc. ACM SIGCOMM '02, pp. 133-145, Aug. 2002.
[24] P. Barford, A. Bestavros, J. Byers, and M. Crovella, “On the Marginal Utility of Network Topology Measurements,” Proc. ACM Internet Measurement Workshop (IMW '01), pp. 5-17, Nov. 2001.
[25] A. Broido and K. Claffy, “Internet Topology: Connectivity of IP Graphs,” Proc. SPIE Int'l Conf. and Exhibits on the Convergence of IT and Comm. (ITCom '01), Aug. 2001.
[26] B. Yao, R. Viswanathan, F. Chang, and D.G. Waddington, “Topology Inference in the Presence of Anonymous Routers,” Proc. IEEE INFOCOM '03, pp. 353-363, Apr. 2003.
[27] M. Faloutsos, P. Faloutsos, and C. Faloutsos, “On Power-Law Relationships of the Internet Topology,” Proc. ACM SIGCOMM '99, pp. 251-262, Sept. 1999.
[28] T.S.E. Ng and H. Zhang, “Predicting Internet Network Distance with Coordinates-Based Approaches,” Proc. IEEE INFOCOM '02, pp. 170-179, June 2002.
[29] F. Dabek, R. Cox, F. Kaashoek, and R. Morris, “Vivaldi: A Decentralized Network Coordinate System,” Proc. ACM SIGCOMM '04, pp. 15-26, Aug. 2004.
[30] X. Jin, Q. Xia, and S.-H.G. Chan, “A Distributed Approach to End-to-End Network Topology Inference,” Proc. IEEE Int'l Conf. Comm. (ICC '07), June 2007.
[31] X. Jin, W.-P.K. Yiu, and S.-H.G. Chan, “Improving the Efficiency of End-to-End Network Topology Inference,” Proc. IEEE Int'l Conf. Comm. (ICC '07), June 2007.
[32] X. Zhang, J. Liu, B. Li, and T.-S.P. Yum, “CoolStreaming/DONet: A Data-Driven Overlay Network for Peer-to-Peer Live Media Streaming,” Proc. IEEE INFOCOM '05, pp. 2102-2111, Mar. 2005.
[33] Z. Fei and M. Yang, “A Proactive Tree Recovery Mechanism forResilient Overlay Multicast,” IEEE/ACM Trans. Networking, vol. 15, no. 1, pp. 173-186, Feb. 2007.
[34] K. Sripanidkulchai, A. Ganjam, B. Maggs, and H. Zhang, “The Feasibility of Supporting Large-Scale Live Streaming Applications with Dynamic Application End-Points,” Proc. ACM SIGCOMM '04, pp. 107-120, Aug. 2004.
[35] G. Tan and S.A. Jarvis, “Improving the Fault Resilience of Overlay Multicast for Media Streaming,” IEEE Trans. Parallel and Distributed Systems, vol. 18, no. 6, pp. 721-734, June 2007.
[36] V.N. Padmanabhan and L. Subramanian, “An Investigation of Geographic Mapping Techniques for Internet Hosts,” Proc. ACM SIGCOMM '01, pp. 173-185, Aug. 2001.
[37] J. Jannotti, D.K. Gifford, K.L. Johnson, M.F. Kaashoek, and J.W. O'Toole, “Overcast: Reliable Multicasting with an Overlay Network,” Proc. Fourth Symp. Operating System Design and Implementation (OSDI '00), pp. 197-212, Oct. 2000.
[38] E. Zegura, K. Calvert, and S. Bhattacharjee, “How to Model an Internetwork,” Proc. IEEE INFOCOM '96, pp. 594-602, Mar. 1996.
[39] PlanetLab, http:/, 2007.
6 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool