High-Performance Distributed Computing, International Symposium on (2002)
July 24, 2002 to July 26, 2002
E. Jeannot , LORIA, Univ. Henri Poincare, Nancy, France
Quickly transmitting large datasets in the context of distributed computing on wide area networks can be achieved by compressing data before transmission, However such an approach is not efficient when dealing with higher speed networks. Indeed, the time to compress a large file and to send it is greater than the time to send the uncompressed file. In this paper we explore and enhance an algorithm that allows us to overlap communications with compression and to automatically adapt the compression effort to currently available network and processor resources.
Data compression, Distributed computing, LAN interconnection, Concurrent computing, Spine, Network servers, Bandwidth, Algorithm design and analysis, File systems, Laboratories
E. Jeannot, B. Knutsson, M. Bjorkman, "Adaptive online data compression", High-Performance Distributed Computing, International Symposium on, vol. 00, no. , pp. 379-388, 2002, doi:10.1109/HPDC.2002.1029938