This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
A Dynamic Performance-Based Flow Control Method for High-Speed Data Transfer
January 2010 (vol. 21 no. 1)
pp. 114-125
ASCII Text
x 
 
Ben Eckart, Xubin He, Qishi Wu, Changsheng Xie, "A Dynamic Performance-Based Flow Control Method for High-Speed Data Transfer," IEEE Transactions on Parallel and Distributed Systems, vol. 21, no. 1, pp. 114-125, January, 2010.
 
 
BibTex
x
 
@article{ 10.1109/TPDS.2009.37,
author = {Ben Eckart and Xubin He and Qishi Wu and Changsheng Xie},
title = {A Dynamic Performance-Based Flow Control Method for High-Speed Data Transfer},
journal ={IEEE Transactions on Parallel and Distributed Systems},
volume = {21},
number = {1},
issn = {1045-9219},
year = {2010},
pages = {114-125},
doi = {http://doi.ieeecomputersociety.org/10.1109/TPDS.2009.37},
publisher = {IEEE Computer Society},
address = {Los Alamitos, CA, USA},
}
 
 
RefWorks Procite/RefMan/Endnote
x 
 
TY - JOUR
JO - IEEE Transactions on Parallel and Distributed Systems
TI - A Dynamic Performance-Based Flow Control Method for High-Speed Data Transfer
IS - 1
SN - 1045-9219
SP114
EP125
EPD - 114-125
A1 - Ben Eckart,
A1 - Xubin He,
A1 - Qishi Wu,
A1 - Changsheng Xie,
PY - 2010
KW - Flow control
KW - high-speed protocol
KW - reliable UDP
KW - bulk transfer.
VL - 21
JA - IEEE Transactions on Parallel and Distributed Systems
ER -
 
Ben Eckart, Tennessee Technological University, Cookeville
Xubin He, Tennessee Technological University, Cookeville
Qishi Wu, University of Memphis, Memphis
Changsheng Xie, Huazhong University of Science and Technology, Wuhan
New types of specialized network applications are being created that need to be able to transmit large amounts of data across dedicated network links. TCP fails to be a suitable method of bulk data transfer in many of these applications, giving rise to new classes of protocols designed to circumvent TCP's shortcomings. It is typical in these high-performance applications, however, that the system hardware is simply incapable of saturating the bandwidths supported by the network infrastructure. When the bottleneck for data transfer occurs in the system itself and not in the network, it is critical that the protocol scales gracefully to prevent buffer overflow and packet loss. It is therefore necessary to build a high-speed protocol adaptive to the performance of each system by including a dynamic performance-based flow control. This paper develops such a protocol, Performance Adaptive UDP (henceforth PA-UDP), which aims to dynamically and autonomously maximize performance under different systems. A mathematical model and related algorithms are proposed to describe the theoretical basis behind effective buffer and CPU management. A novel delay-based rate-throttling model is also demonstrated to be very accurate under diverse system latencies. Based on these models, we implemented a prototype under Linux, and the experimental results demonstrate that PA-UDP outperforms other existing high-speed protocols on commodity hardware in terms of throughput, packet loss, and CPU utilization. PA-UDP is efficient not only for high-speed research networks, but also for reliable high-performance bulk data transfer over dedicated local area networks where congestion and fairness are typically not a concern.

[1] N.S.V. Rao, W.R. Wing, S.M. Carter, and Q. Wu, “Ultrascience Net: Network Testbed for Large-Scale Science Applications,” IEEE Comm. Magazine, vol. 43, no. 11, pp. S12-S17, Nov. 2005.
[2] X. Zheng, M. Veeraraghavan, N.S.V. Rao, Q. Wu, and M. Zhu, “CHEETAH: Circuit-Switched High-Speed End-to-End Transport Architecture Testbed,” IEEE Comm. Magazine, vol. 43, no. 8, pp. 11-17, Aug. 2005.
[3] On-Demand Secure Circuits and Advance Reservation System, http://www.es.netoscars, 2009.
[4] User Controlled LightPath Provisioning, http://phi.badlab.crc. cauclp, 2009.
[5] Enlightened Computing, www.enlightenedcomputing.org, 2009.
[6] Dynamic Resource Allocation via GMPLS Optical Networks, http:/dragon.maxgigapop.net, 2009.
[7] JGN II: Advanced Network Testbed for Research and Development, http:/www.jgn.nict.go.jp, 2009.
[8] Geant2, http:/www.geant2.net, 2009.
[9] Hybrid Optical and Packet Infrastructure, http://networks. internet2.eduhopi, 2009.
[10] Z.-L. Zhang, “Decoupling QoS Control from Core Routers: A Novel Bandwidth Broker Architecture for Scalable Support of Guaranteed Services,” Proc. ACM SIGCOMM '00, pp. 71-83, 2000.
[11] N.S.V. Rao, Q. Wu, S. Ding, S.M. Carter, W.R. Wing, A. Banerjee, D. Ghosal, and B. Mukherjee, “Control Plane for Advance Bandwidth Scheduling in Ultra High-Speed Networks,” Proc. IEEE INFOCOM, 2006.
[12] K. Wehrle, F. Pahlke, H. Ritter, D. Muller, and M. Bechler, Linux Network Architecture. Prentice-Hall, Inc., 2004.
[13] S. Floyd, “RFC 2914: Congestion Control Principles,” Category: Best Current Practise, ftp://ftp.isi.edu/in-notesrfc2914.txt, Sept. 2000.
[14] V. Jacobson, R. Braden, and D. Borman, “RFC 2647: Tcp Extensions for High Performance,” United States, http://www.ietf.org/rfcrfc1323.txt, 1992.
[15] A. Hanushevsky, “Peer-to-Peer Computing for Secure High Performance Data Cop,” http://www.osti.gov/servlets/purl/826702-5UdHlZ native/, Apr. 2007.
[16] R.L. Grossman, M. Mazzucco, H. Sivakumar, Y. Pan, and Q. Zhang, “Simple Available Bandwidth Utilization Library for High-Speed Wide Area Networks,” J. Supercomputing, vol. 34, no. 3, pp. 231-242, 2005.
[17] Y. Gu and R.L. Grossman, “UDT: UDP-Based Data Transfer for High-Speed Wide Area Networks,” Computer Networks, vol. 51, no. 7, pp. 1777-1799, 2007.
[18] E. He, J. Leigh, O.T. Yu, and T.A. DeFanti, “Reliable Blast UDP: Predictable High Performance Bulk Data Transfer,” Proc. IEEE Int'l Conf. Cluster Computing, pp. 317-324, http:/csdl.computer.org/, 2002.
[19] M. Meiss, “Tsunami: A High-Speed Rate-Controlled Protocol for File Transfer,” www.evl.uic.edu/eric/atpTSUNAMI.pdf/, 2009.
[20] M. Goutelle, Y. Gu, and E. He, “A Survey of Transport Protocols Other than Standard tcp,” citeseer.ist.psu.eduhe05survey.html, 2004.
[21] D. Newman, “RFC 2647: Benchmarking Terminology for Firewall Performance,” www.ietf.org/rfcrfc2647.txt, 1999.
[22] Y. Gu and R.L. Grossman, “Optimizing udp-Based Protocol Implementations,” Proc. Third Int'l Workshop Protocols for Fast Long-Distance Networks (PFLDnet), 2005.
[23] R.L. Grossman, Y. Gu, D. Hanley, X. Hong, and B. Krishnaswamy, “Experimental Studies of Data Transport and Data Access of Earth-Science Data over Networks with High Bandwidth Delay Products,” Computer Networks, vol. 46, no. 3, pp. 411-421, , 2004.
[24] A.C. Heursch and H. Rzehak, “Rapid Reaction Linux: Linux with Low Latency and High Timing Accuracy,” Proc. Fifth Ann. Linux Showcase & Conf. (ALS '01), p. 4, 2001.
[25] “Low Latency: Eliminating Application Jitter with Solaris,” White Paper, Sun Microsystems, May 2007.
[26] L.S. Brakmo and S.W. O'Malley, “Tcp Vegas: New Techniques for Congestion Detection and Avoidance,” Proc. ACM SIGCOMM '94, pp. 24-35, Oct. 1994.
[27] T. Dunigan, M. Mathis, and B. Tierney, “A tcp Tuning Daemon,” Proc. Supercomputing Conf.: High-Performance Networking and Computing, Nov. 2002.
[28] A. Falk, T. Faber, J. Bannister, A. Chien, R. Grossman, and J. Leigh, “Transport Protocols for High Performance,” Comm. ACM, vol. 46, no. 11, pp. 43-49, 2002.
[29] S. Floyd, “Highspeed TCP for Large Congestion Windows,” Internet Draft, Feb. 2003.
[30] V. Jacobson, “Congestion Avoidance and Control,” Proc. ACM SIGCOMM '88, pp. 314-29, 1988.
[31] D. Katabi, M. Handley, and C. Rohrs, “Internet Congestion Control for Future High-Bandwidth-Delay Product Environments,” Proc. ACM SIGCOMM '02, http://dx.doi.org/10.1016/j.comnet.2004.06.016www.acm.org/ sigcomm/sigcomm2002/papers xcp.pdf, Aug. 2002.
[32] T. Kelly, “Scalable TCP: Improving Performance in Highspeed Wide Area Networks,” Proc. Workshop Protocols for Fast Long-Distance Networks, Feb. 2003.
[33] A. Kuzmanovic, E. Knightly, and R.L. Cottrell, “HSTCP-LP: A Protocol for Low-Priority Bulk Data Transfer in High-Speed High-RTT Networks,” Proc. Second Int'l Workshop Protocols for Fast Long-Distance Networks, Feb. 2004.
[34] S.H. Low, L.L. Peterson, and L. Wang, “Understanding Vegas: A Duality Model,” J. ACM, vol. 49, no. 2, pp. 207-235, Mar. 2002.
[35] A.P. Mudambi, X. Zheng, and M. Veeraraghavan, “A Transport Protocol for Dedicated End-to-End Circuits,” Proc. IEEE Int'l Conf. Comm., 2006.
[36] R. Prasad, M. Jain, and C. Dovrolis, “Socket Buffer Auto-Sizing for High-Performance Data Transfers,” J. Grid Computing, vol. 1, no. 4, pp. 361-376, 2004.
[37] N.S.V. Rao, J. Gao, and L.O. Chua “Chapter on Dynamics of Transport Protocols in Wide Area Internet Connections,” Complex Dynamics in Communication Networks, Springer-Verlag, 2004.
[38] N. Rao, W. Wing, Q. Wu, N. Ghani, Q. Liu, T. Lehman, C. Guok, and E. Dart, “Measurements on Hybrid Dedicated Bandwidth Connections,” Proc. High-Speed Networks Workshop, pp. 41-45, May 2007.
[39] N.S.V. Rao, Q. Wu, S.M. Carter, and W.R. Wing, “High-Speed Dedicated Channels and Experimental Results with Hurricane Protocol,” Annals of Telecomm., vol. 61, nos. 1/2, pp. 21-45, 2006.
[40] J. Semke, J. Madhavi, and M. Mathis, “Automatic TCP Buffer Tuning,” Proc. ACM SIGCOMM '98, Aug. 1998.
[41] S. Shalunov and B. Teitelbaum, “A Weekly Version of the Bulk TCP Use and Performance on Internet2,” Internet2 Netflow: Weekly Reports, 2004.
[42] R. Stewart and Q. Xie, Stream Control Transmission Protocol, IETF RFC 2960, www.ietf.org/rfcrfc2960.txt, Oct. 2000.
[43] S. Floyd, “Highspeed TCP for Large Congestion Windows,” citeseer.ist.psu.edu/articlefloyd02highspeed.html , 2002.
[44] T. Kelly, “Scalable TCP: Improving Performance in Highspeed Wide Area Networks,” ACM SIGCOMM Computer Comm. Rev., vol. 33, no. 2, pp. 83-91, 2003.
[45] Y. Zhang and M. Ahmed, “A Control Theoretic Analysis of XCP,” Proc. IEEE INFOCOM, pp. 2831-2835, 2005.
[46] C. Jin, D.X. Wei, S.H. Low, J.J. Bunn, H.D. Choe, J.C. Doyle, H.B. Newman, S. Ravot, S. Singh, F. Paganini, G. Buhrmaster, R.L. Cottrell, O. Martin, and W. chun Feng, “FAST TCP: From Theory to Experiments,” IEEE Network, vol. 19, no. 1, pp. 4-11, Jan./Feb. 2005.

Index Terms:
Flow control, high-speed protocol, reliable UDP, bulk transfer.
Citation:
Ben Eckart, Xubin He, Qishi Wu, Changsheng Xie, "A Dynamic Performance-Based Flow Control Method for High-Speed Data Transfer," IEEE Transactions on Parallel and Distributed Systems, vol. 21, no. 1, pp. 114-125, Jan. 2010, doi:10.1109/TPDS.2009.37
Usage of this product signifies your acceptance of the Terms of Use.