This Article 
 Bibliographic References 
 Add to: 
Effective Delay-Controlled Load Distribution over Multipath Networks
Oct. 2011 (vol. 22 no. 10)
pp. 1730-1741
Sumet Prabhavat, Tohoku University, Sendai
Hiroki Nishiyama, Tohoku University, Sendai
Nirwan Ansari, New Jersey Institute of Technology, Newark
Nei Kato, Tohoku University, Sendai
Owing to the heterogeneity and high degree of connectivity of various networks, there likely exist multiple available paths between a source and a destination. An effective model of delay-controlled load distribution becomes essential to efficiently utilize such parallel paths for multimedia data transmission and real-time applications, which are commonly known to be sensitive to packet delay, packet delay variation, and packet reordering. Recent research on load distribution has focused on load balancing efficiency, bandwidth utilization, and packet order preservation; however, a majority of the solutions do not address delay-related issues. This paper proposes a new load distribution model aiming to minimize the difference among end-to-end delays, thereby reducing packet delay variation and risk of packet reordering without additional network overhead. In general, the lower the risk of packet reordering, the smaller the delay induced by the packet reordering recovery process, i.e., extra delay induced by the packet reordering recovery process is expected to decrease. Therefore, our model can reduce not only the end-to-end delay but also the packet reordering recovery time. Finally, our proposed model is shown to outperform other existing models, via analysis and simulations.

[1] L. Golubchik, J. Lui, T. Tung, A. Chow, W. Lee, G. Franceschinis, and C. Anglano, "Multi-Path Continuous Media Streaming: What Are the Benefits?" Performance Evaluation, vol. 49, pp. 429-449, Sept. 2002.
[2] C. Villamizar, "OSPF Optimized Multipath (OSPF-OMP)," Internet Draft Draft-Ietf-Ospf-Omp-02.txt, vol. ospt, no. 2, pp. 1-38, Feb. 1999.
[3] D. Thaler and C. Hopps, "Multipath Issues in Unicast and Multicast Next-Hop Selection," RFC 2991, Nov. 2000.
[4] C. Hopps, "Analysis of an Equal-Cost Multi-Path Algorithm," RFC 2992, Nov. 2000.
[5] H. Adiseshu, G. Parulkar, and G. Varghese, "A Reliable and Scalable Striping Protocol," ACM SIGCOMM Computer Comm. Rev., vol. 26, no. 4, pp. 131-141, Oct. 1996.
[6] A. Zinin, Cisco IP Routing, Packet Forwarding and Intra-Domain Routing Protocols. Addison Wesley, 2002.
[7] J. Song, S. Kim, M. Lee, H. Lee, and T. Suda, "Adaptive Load Distribution over Multipath in MPLS Networks," Proc. IEEE Int'l Conf. Comm. (ICC '03), pp. 233-237, May 2003.
[8] W. Shi, M.H. MacGregor, and P. Gburzynski, "Load Balancing for Parallel Forwarding," IEEE/ACM Trans. Networking, vol. 13, no. 4, pp. 790-801, Aug. 2005.
[9] S. Kandula, D. Katabi, S. Sinha, and A. Berger, "Dynamic Load Balancing without Packet Reordering," ACM SIGCOMM Computer Comm. Rev., vol. 37, no. 2, pp. 53-62, Apr. 2007.
[10] K.C. Leung and V.O.K. Li, "Generalized Load Sharing for Packet-Switching Networks: Theory and Packet-Based Algorithm," IEEE Trans. Parallel and Distributed System, vol. 17, no. 7, pp. 694-702, July 2006.
[11] K.G. Shin and C.J. Hou, "Design and Evaluation of Effective Load Sharing in Distributed Real-Time Systems," IEEE Trans. Parallel and Distributed Systems, vol. 5, no. 7, pp. 704-719, July 1994.
[12] O. Kremien and J. Kramer, "Methodical Analysis of Adaptive Load Sharing Algorithms," IEEE Trans. Parallel and Distribution Systems, vol. 3, no. 6, pp. 747-760, Nov. 1992.
[13] C.C. Hui and S.T. Chanson, "Hydrodynamic Load Balancing," IEEE Trans. Parallel and Distributed Systems, vol. 10, no. 11, pp. 1118-1137, Nov. 1999.
[14] Z. Tari, J. Broberg, A. Zomaya, and R. Baldoni, "A Least Flow-Time First Load Sharing Approach for Distributed Server Farm," J. Parallel and Distributed Computing, vol. 65, no. 7, pp. 832-842, July 2005.
[15] A.K. Parekh and R.G. Gallager, "A Generalized Processor Sharing Approach to Flow Control in Integrated Services Networks: The Single Node Case," IEEE/ACM Trans. Networking, vol. 1, no. 3, pp. 344-357, June 1993.
[16] G. Malkin, "RIP Version 2," RFC 2453, Nov. 1998.
[17] J. Moy, "OSPF Version 2," RFC 2328, Apr. 1998.
[18] Cisco Systems Inc., "Enhanced Interior Gateway Routing Protocol (EIGRP)," Cisco white paper EIGRP, or shtml , 2011.
[19] J. Kulkarni and N. Anand, "Equal Cost Routes Support for RIP/RIPNG," draft-janardhan-naveen-rtgwg-equalcostroutes-rip-00, June 2007.
[20] R. Chandra, P. Bahl, and P. Bahl, "MultiNet: Connecting to Multiple IEEE 802.11 Networks Using a Single Wireless Card," Proc. IEEE INFOCOM, pp. 882-893. Mar. 2004.
[21] M.K. Marina and S.R. Das, "On-Demand Multipath Distance Vector Routing in Ad Hoc Networks," Proc. Ninth IEEE Int'l Conf. Network Protocols (ICNP), Nov. 2001.
[22] S.J. Lee and M. Gerla, "Split Multipath Routing with Maximally Disjoint Paths in Ad Hoc Networks," Proc. IEEE Int'l Conf. Comm. (ICC), pp. 3201-3205. June 2001.
[23] L. Wang, Y. Shu, M. Dong, L. Zhang, and O. Yang, "Adaptive Multipath Source Routing in Ad Hoc Networks," Proc. IEEE Int'l Conf. Comm. (ICC), pp. 867-871, June 2001.
[24] Z. Ye, S.V. Krishnamurthy, and S.K. Tripathi, "A Framework for Reliable Routing in Mobile Ad Hoc Networks," Proc. IEEE INFOCOM, pp. 270-280, Mar. 2003.
[25] D.G. Thaler and C.V. Ravishankar, "Using Name-Based Mappings to Increase Hit Rates," IEEE/ACM Trans. Networking, vol. 6, no. 1, pp. 1-14, Feb. 1998.
[26] Y. Lee and Y. Choi, "An Adaptive Flow-Level Load Control Scheme for Multipath Forwarding," LNCS, vol. 2093, pp. 771-779, Springer-Verlag, July 2001.
[27] Z. Cao, Z. Wang, and E. Zegura, "Performance of Hashing Based Schemes for Internet Load Balancing," Proc. IEEE INFOCOM, pp. 332-341, Mar. 2000.
[28] V. Paxson, G. Almes, J. Mahdavi, and M. Mathis, "Framework for IP Performance Metrics," RFC 2330, May. 1998.
[29] C. Demichelis and P. Chimento, "IP Packet Delay Variation Metric for IP Performance Metrics (IPPM)," RFC 3393, Nov. 2002.
[30] N.M. Piratla, A.P. Jayasumana, A.A. Bare, and T. Banka, "Reorder Buffer-Occupancy Density and Its Application for Measurement and Evaluation of Packet Reordering," Computer Comm., vol. 30, no. 9, pp. 1980-1993, June 2007.
[31] N.M. Piratla and A.P. Jayasumana, "Reordering of Packets Due to Multipath Forwarding—An Analysis," Proc. IEEE Int'l Conf. Comm. (ICC), pp. 829-834, June 2006.
[32] A. Morton, L. Ciavattone, G. Ramachandran, S. Shalunov, and J. Perser, "Packet Reordering Metrics," RFC 4737, Nov. 2006.
[33] A. Jayasumana, N. Piratla, T. Banka, and R. Whitner, "Improved Packet Reordering Metrics," RFC 5236, June 2008.
[34] S. Jaiswal, G. Iannaccone, C. Diot, J. Kurose, and D. Towsley, "Measurement and Classification of Out-of-Sequence Packets in a Tier-1 IP Backbone," IEEE/ACM Trans. Networking, vol. 15, no. 1, pp. 54-66, Feb. 2007.
[35] J.C.R. Bennett, C. Partridge, and N. Shectman, "Packet Reordering Is Not Pathological Network Behavior," IEEE/ACM Trans. Networking, vol. 7, no. 6, pp. 789-798, Dec. 1999.
[36] G. Iannaccone, S. Jaiswal, and C. Diot, "Packet Reordering inside the Sprint Backbone," Technical Report TR01-ATL-062917, Sprint ATL, June 2001.
[37] D. Loguinov and H. Radha, "Measurement Study of Low-Bitrate Internet Video Streaming," Proc. First ACM SIGCOMM Workshop Internet Measurements, pp. 281-293, Nov. 2001.
[38] S. Prabhavat, H. Nishiyama, N. Ansari, and N. Kato, "On the Performance Analysis of Traffic Splitting on Load Imbalancing and Packet Reordering of Bursty Traffic," Proc. IEEE Int'l Conf. Network Infrastructure and Digital Content (IC-NIDC '09), Nov. 2009.
[39] G. Almes, S. Kalidindi, and M. Zekauskas, "A One-Way Delay Metric for IPPM," RFC 2679, Sept. 1999.
[40] H. Schulzrinne, S. Casner, R. Frederick, and V. Jacobson, "RTP: A Transport Protocol for Real-Time Applications," RFC 3550, July 2003.
[41] S. Prabhavat, H. Nishiyama, Y. Nemoto, N. Ansari, and N. Kato, "Load Distribution with Queuing Delay Bound over Multipath Networks: Rate Control Using Stochastic Delay Prediction," Proc. 26th Int'l Comm. Satellite Systems Conf. (ICSSC), June 2008.
[42] M. Shreedhar and G. Varghese, "Efficient Fair Queueing Using Deficit Round Robin," IEEE/ACM Trans. Networking, vol. 4, no. 3, pp. 375-385, June 1996.
[43] D. Awduche, A. Chiu, A. Elwalid, I. Widjaja, and X. Xiao, "Overview and Principles of Internet Traffic Engineering," RFC 3272, May. 2000.
[44] E. Rosen, A. Viswanathan, and R. Callon, "Multiprotocol Label Switching Architecture," RFC 3031, Jan. 2001.
[45] P. Danzig, J. Mogul, V. Paxson, and M. Schwartz, "The Internet Traffic Archive,", Mar. 1995.

Index Terms:
Delay minimization, load distribution, multipath forwarding, packet reordering, packet delay variation.
Sumet Prabhavat, Hiroki Nishiyama, Nirwan Ansari, Nei Kato, "Effective Delay-Controlled Load Distribution over Multipath Networks," IEEE Transactions on Parallel and Distributed Systems, vol. 22, no. 10, pp. 1730-1741, Oct. 2011, doi:10.1109/TPDS.2011.43
Usage of this product signifies your acceptance of the Terms of Use.