|
| This Article | ||
| ||
| Share | ||
| Bibliographic References | ||
| Add to: | ||
| | ||
| Search | ||
| ||
2010 International Conference on Distributed Computing Systems
New Algorithms for Planning Bulk Transfer via Internet and Shipping Networks
Genova, Italy
June 21-June 25
ISBN: 978-0-7695-4059-7
| ASCII Text | x | ||
| Brian Cho, Indranil Gupta, "New Algorithms for Planning Bulk Transfer via Internet and Shipping Networks," 2012 IEEE 32nd International Conference on Distributed Computing Systems, pp. 305-314, 2010 International Conference on Distributed Computing Systems, 2010. | |||
| BibTex | x | ||
| @article{ 10.1109/ICDCS.2010.59, author = {Brian Cho and Indranil Gupta}, title = {New Algorithms for Planning Bulk Transfer via Internet and Shipping Networks}, journal ={2012 IEEE 32nd International Conference on Distributed Computing Systems}, volume = {0}, year = {2010}, issn = {1063-6927}, pages = {305-314}, doi = {http://doi.ieeecomputersociety.org/10.1109/ICDCS.2010.59}, publisher = {IEEE Computer Society}, address = {Los Alamitos, CA, USA}, } | |||
| RefWorks Procite/RefMan/Endnote | x | ||
| TY - CONF JO - 2012 IEEE 32nd International Conference on Distributed Computing Systems TI - New Algorithms for Planning Bulk Transfer via Internet and Shipping Networks SN - 1063-6927 SP305 EP314 A1 - Brian Cho, A1 - Indranil Gupta, PY - 2010 VL - 0 JA - 2012 IEEE 32nd International Conference on Distributed Computing Systems ER - | |||
DOI Bookmark: http://doi.ieeecomputersociety.org/10.1109/ICDCS.2010.59
Cloud computing is enabling groups of academic collaborators, groups of business partners, etc., to come together in an ad-hoc manner. This paper focuses on the group-based data transfer problem in such settings. Each participant source site in such a group has a large dataset, which may range in size from gigabytes to terabytes. This data needs to be transferred to a single sink site (e.g., AWS, Google datacenters, etc.) in a manner that reduces both total dollar costs incurred by the group as well as the total transfer latency of the collective dataset. This paper is the first to explore the problem of planning a group-based deadline-oriented data transfer in a scenario where data can be sent over both: (1) the internet, and (2) by shipping storage devices (e.g., external or hot-plug drives, or SSDs) via companies such as Fedex, UPS, USPS, etc. We first formalize the problem and prove its NP-Hardness. Then, we propose novel algorithms and use them to build a planning system called Pandora (People and Networks Moving Data Around). Pandora uses new concepts of time-expanded networks and delta-time-expanded networks, combining them with integer programming techniques and optimizations for both shipping and internet edges. Our experimental evaluation using real data from Fedex and from PlanetLab indicate the Pandora planner manages to satisfy deadlines and reduce costs significantly.
Citation:
Brian Cho, Indranil Gupta, "New Algorithms for Planning Bulk Transfer via Internet and Shipping Networks," icdcs, pp.305-314, 2010 International Conference on Distributed Computing Systems, 2010
Usage of this product signifies your acceptance of the Terms of Use.
