| | This Article | |
| |
| |
| | Share | |
| |
| |
| | Bibliographic References | |
| |
| |
| | Add to: | |
| |
 Digg
 Furl
 Spurl
 Blink
 Simpy
 Google
 Del.icio.us
 Y!MyWeb
| |
| | Search | |
| |
| |
| | |
Orchestration of Network-Wide Active Measurements for Supporting Distributed Computing Applications
December 2007 (vol. 56 no. 12)
pp. 1629-1642
Abstract—Recent computing applications such as videoconferencing and Grid computing run their tasks on distributed computing resources connected through networks. For such applications, knowledge of the network status such as delay, jitter, and available bandwidth can help them select proper network resources to meet the Quality of Service (QoS) requirements. Also, the applications can dynamically change the resource selection if the current selection is found to experience poor performance. For such purposes, Internet Service Providers (ISPs) have started to instrument their networks with Network Measurement Infrastructures (NMIs) that run active measurement tasks periodically and/or on-demand. However, one problem that most network engineers have overlooked is the measurement conflict problem, which happens when multiple active measurement tasks inject probing packets to the same network segment at the same time, resulting in misleading reports of network performance due to their combined effects. This paper proposes enhanced EDF (Earliest Deadline First) algorithms that allow ?Concurrent Executions? to orchestrate offline/online measurement jobs in a conflict-free manner. The simulation study shows that our measurement scheduling mechanism can improve the schedulable utilization of offline measurement tasks up to 300% and the response time of on-demand jobs up to 50%. Further, we implement and deploy our scheduling mechanism in a real working NMI for monitoring the Internet2 Abilene network. As a case study, we show the utility of our algorithms in the widely-used Network Weather Service (NWS).
[1] 1629 P. Calyam, C.-G. Lee, P.K. Arava, and D. Krymskiy, “Enhanced EDF Scheduling Algorithms for Orchestrating Network-Wide Active Measurements,” Proc. 26th IEEE Int'l Real-Time Systems Symp. (RTSS '05), 2005.[2] P. Calyam, W. Mandrawa, M. Sridharan, A. Khan, and P. Schopis, “H.323 Beacon: An H.323 Application Related End-to-End Performance Troubleshooting Tool,” Proc. ACM SIGCOMM Workshop Network Troubleshooting (NetTs '04), 2004.[3] T. McGregor, H.-W. Braun, and J. Brown, “The NLANR Network Analysis Infrastructure,” IEEE Comm. Magazine, 2000.[4] P. Calyam, D. Krymskiy, M. Sridharan, and P. Schopis, “TBI: End-to-End Network Performance Measurement Testbed for Empirical Bottleneck Detection,” Proc. First IEEE Int'l Conf. Testbeds and Research Infrastructures for the Development of Networks and Communities (TridentCom '05), 2005.[5] E. Boyd, J. Boote, S. Shalunov, and M. Zekauskas, “The Internet2 E2E piPES Project: An Interoperable Federation of Measurement Domains for Performance Debugging,” Internet2 Technical Report, 2004.[6] A. Tirumala, L. Cottrell, and T. Dunigan, “Measuring End-To-End Bandwidth with Iperf Using Web100,” Proc. Fifth Passive and Active Measurement Workshop (PAM '03), 2003.[7] A. Downey, “Using Pathchar to Estimate Internet Link Characteristics,” Proc. ACM Ann. Conf. Applications, Technologies, Architectures, and Protocols for Computer Comm. (SIGCOMM), 1999.[8] C. Dovrolis, P. Ramanathan, and D. Moore, “Packet Dispersion Techniques and Capacity Estimation,” IEEE/ACM Trans. Networking, 2004.[9] R. Wolski, N. Spring, and J. Hayes, “The Network Weather Service: A Distributed Resource Performance Forecasting Service for Metacomputing,” Future Generation Computer Systems, 1999.[10] J. Liu, Real-Time Systems. Prentice Hall, 2000.[11] S. Kalidindi and M. Zekauskas, “Surveyor: An Infrastructure for Internet Performance Measurements,” Proc. Ninth INET Conf., 1999.[12] M. Alves, L. Corsello, D. Karrenberg, C. Ogut, M. Santcroos, R. Sojka, H. Uijterwaak, and R. Wilhelm, “New Measurements with the RIPE NCC Test Traffic Measurements Setup,” Proc. Fourth Passive and Active Measurements Workshop (PAM '02), 2002.[13] B. Gaidioz, R. Wolski, and B. Tourancheau, “Synchronizing Network Probes to Avoid Measurement Intrusiveness with the Network Weather Service,” Proc. Ninth IEEE Int'l Symp. High-Performance Distributed Computing (HPDC '00), 2000.[14] H. Wang, D. Zhang, and K. Shin, “Change-Point Monitoring for Detection of DoS Attacks,” IEEE Trans. Dependable and Secure Computing, vol. 1, no. 4, pp. 193-208, Oct.-Dec. 2004.[15] P. Calyam, C.-G. Lee, P.K. Arava, D. Krymskiy, and D. Lee, “OnTimeMeasure: A Scalable Framework for Scheduling Active Measurements,” Proc. Third IEEE/IFIP Workshop End-to-End Monitoring Techniques and Services (E2EMON '05), 2005.[16] K. Raymond, “A Tree-Based Algorithm for Distributed Mutual Exclusion,” ACM Trans. Computer Systems, 1989.[17] GGF NMWG Request/Response Schema, nmwg.internet2.edu, 2006.[18] J. Steiner, C. Neuman, and J. Schiller, “Kerberos: An Authentication Service for Open Network Systems,” Proc. Usenix Ann. Technical Conf., 1998.[19] F. Berman and R. Wolski, “Scheduling from the Perspective of the Application,” Proc. Fifth Int'l Symp. High-Performance Distributed Computing (HPDC '96), 1996.[20] A. Grimshaw, W. Wulf, J. French, A. Weaver, and P. Reynolds, “Legion: The Next Logical Step towards a Nationwide Virtual Computer,” Technical Report CS-94-21, Univ. of Virginia, 1994.[21] T. Defanti, I. Foster, M. Papka, R. Stevens, and T. Kuhfuss, “Overview of the I-WAY: Wide Area Visual Supercomputing,” Int'l J. Supercomputer Applications, 1996.[22] D. Reed and C. Mendes, “Intelligent Monitoring for Adaptation in Grid Applications,” Proc. IEEE, 2005.[23] R. Prasad, M. Jain, and C. Dovrolis, “Effects of Interrupt Coalescence on Network Measurements,” Proc. Sixth Passive and Active Measurement Workshop (PAM '04), 2004.[24] J. Han and F. Jahanian, “Impact of Path Diversity on Multi-Homed and Overlay Networks,” Proc. 38th IEEE Ann. Conf. Dependable Systems and Networks (DSN '04), 2004.[25] Boston Univ., BRITE: Representative Internet Topology Generator, http://www.cs.bu.edubrite, 2006.[26] Middleware Initiative, NWS User's Guide, http://archive.nsf-middleware.org/documentation/ NMI-R5/0/gridscenter/NWSusers_guide.htm , 2006.
Index Terms:
Active network probes, Measurement conflict, Real-time scheduling, Concurrent execution, Network Weather Service
Citation:
Prasad Calyam, Chang-Gun Lee, Eylem Ekici, Mark Haffner, Nathan Howes, "Orchestration of Network-Wide Active Measurements for Supporting Distributed Computing Applications," IEEE Transactions on Computers, vol. 56, no. 12, pp. 1629-1642, June 2007, doi:10.1109/TC.2007.70745
