37th Annual IEEE Conference on Local Computer Networks (2012)
Clearwater Beach, FL, USA USA
Oct. 22, 2012 to Oct. 25, 2012
Daqing Yun , Department of Computer Science, The University of Memphis, TN 38152, USA
Qishi Wu , Department of Computer Science, The University of Memphis, TN 38152, USA
Patrick Brown , Department of Computer Science, Southern Illinois University, Carbondale, 62901, USA
Mengxia Zhu , Department of Computer Science, Southern Illinois University, Carbondale, 62901, USA
High-performance networking technologies and services are being rapidly developed and deployed across the nation and around the globe to support the transfer of large data sets generated by next-generation scientific applications for collaborative data processing, analysis, and storage. However, these networking technologies and services have not been fully utilized mainly because their use often requires considerable domain knowledge and many application users are even not aware of their existence. The main goal of our work is to provide end users an integrated solution to discovering system and network resources and composing end-to-end paths for large data transfer. By leveraging the resource discovery capability previously developed in Network-Aware Data Movement Advisor (NADMA), we propose novel profiling and modeling approaches to characterize various types of resources that are available in end systems, edge segments, and backbone networks, taking into consideration a comprehensive set of performance metrics and network parameters in different phases including device deployment, circuit setup, and data transfer. Based on these profiles and models, we formulate a class of transport-support workflow optimization problems where an appropriate set of technologies and services are selected to compose the best transport-support workflow to meet the user's data transfer request in terms of various performance requirements. We conduct wide-area network experiments to validate the cost models and illustrate the efficacy of the proposed workflow-based transport solution.
Data transfer, Bandwidth, IP networks, Reliability, Data models, Internet, Throughput, workflow, Service model, performance modeling, high-performance networking
D. Yun, Q. Wu, P. Brown and M. Zhu, "Modeling and optimizing transport-support workflows in high-performance networks," 37th Annual IEEE Conference on Local Computer Networks(LCN), Clearwater Beach, FL, USA USA, 2012, pp. 384-391.