loading...
 This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Third IEEE International Symposium on Cluster Computing and the Grid (CCGrid'03)
Leveraging Non-Uniform Resources for Parallel Query Processing
Tokyo, Japan
May 12-May 15
ISBN: 0-7695-1919-9
Tobias Mayr, IBM Almaden
Philippe Bonnet, University of Copenhagen
Johannes Gehrke, Cornell University
Praveen Seshadri, Microsoft
Modular clusters are now composed of non- uniform nodes with different CPUs, disks or network cards so that customers can adapt the cluster configuration to the changing technologies and to their changing needs. This challenges dataflow parallelism as the primary load balancing technique of existing parallel database systems. We show in this paper that dataflow parallelism alone is ill suited for modular clusters because running the same operation on different subsets of the data can not fully utilize non-uniform hardware resources.
We propose and evaluate new load balancing techniques that blend pipeline parallelism with data parallelism. We consider relational operators as pipelines of fine-grained operations that can be located on different cluster nodes and executed in parallel on different data subsets to best exploit non-uniform resources. We present an experimental study that confirms the feasibility and effectiveness of the new techniques in a parallel execution engine prototype based on the open-source DBMS Predator.
Citation:
Tobias Mayr, Philippe Bonnet, Johannes Gehrke, Praveen Seshadri, "Leveraging Non-Uniform Resources for Parallel Query Processing," ccgrid, pp.120, Third IEEE International Symposium on Cluster Computing and the Grid (CCGrid'03), 2003
Usage of this product signifies your acceptance of the Terms of Use.