loading...
 This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
21st International Conference on Advanced Networking and Applications (AINA '07)
Parallel Lossless Data Compression Based on the Burrows-Wheeler Transform
Niagara Falls, Ontario, Canada
May 21-May 23
ISBN: 0-7695-2846-5
Jeff Gilchrist, Carleton University, Canada
Aysegul Cuhadar, Carleton University, Canada
In this paper, we present parallel algorithms for lossless data compression based on the Burrows- Wheeler Transform (BWT) block-sorting technique. We investigate the performance of using data parallelism and task parallelism for both multi-threaded and message-passing programming. The output produced by the parallel algorithms is fully compatible with their sequential counterparts. To balance the workload among processors we develop a task scheduling strategy. An extensive set of experiments is performed with a shared memory NUMA system using up to 120 processors and on a distributed memory cluster using up to 100 processors. Our experimental results show that significant speedup can be achieved with both data parallel and task parallel methodologies. These algorithms will greatly reduce the amount of time it takes to compress large amounts of data while the compressed data remains in a form that users without access to multiple processor systems can still use.
Citation:
Jeff Gilchrist, Aysegul Cuhadar, "Parallel Lossless Data Compression Based on the Burrows-Wheeler Transform," aina, pp.877-884, 21st International Conference on Advanced Networking and Applications (AINA '07), 2007
Usage of this product signifies your acceptance of the Terms of Use.