This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
2008 IEEE 24th International Conference on Data Engineering
Sideways Information Passing for Push-Style Query Processing
Cancun, Mexico
April 07-April 12
ISBN: 978-1-4244-1836-7
Zachary G. Ives, Computer and Information Science Department, University of Pennsylvania, Philadelphia, PA, U.S.A. zives@cis.upenn.edu
Nicholas E. Taylor, Computer and Information Science Department, University of Pennsylvania, Philadelphia, PA, U.S.A. netaylor@cis.upenn.edu
In many modern data management settings, data is queried from a central node or nodes, but is stored at remote sources. In such a setting it is common to perform "push-style" query processing, using multithreaded pipelined hash joins and bushy query plans to compute parts of the query in parallel; to avoid idling, the CPU can switch between them as delays are encountered. This works well for simple select-project-join queries, but increasingly, Web and integration applications require more complex queries with multiple joins and even nested subqueries. As we demonstrate in this paper, push-style execution of complex queries can be improved substantially via sideways information passing; push-style queries provide many opportunities for information passing that have not been studied in the past literature. We present adaptive information passing, a general runtime decision-making technique for reusing intermediate state from one query subresult to prune and reduce computation of other subresults. We develop two alternative schemes for performing adaptive information passing, which we study in several settings under a variety of workloads.
Citation:
Zachary G. Ives, Nicholas E. Taylor, "Sideways Information Passing for Push-Style Query Processing," icde, pp.774-783, 2008 IEEE 24th International Conference on Data Engineering, 2008
Usage of this product signifies your acceptance of the Terms of Use.