The Community for Technology Leaders
Green Image
Issue No. 01 - February (1994 vol. 6)
ISSN: 1041-4347
pp: 120-135
<p>To investigate the interactions of extensibility and parallelism in database query processing, we have developed a new dataflow query execution system called Volcano. The Volcano effort provides a rich environment for research and education in database systems design, heuristics for query optimization, parallel query execution, and resource allocation. Volcano uses a standard interface between algebra operators, allowing easy addition of new operators and operator implementations. Operations on individual items, e.g., predicates, are imported into the query processing operators using support functions. The semantics of support functions is not prescribed; any data type including complex objects and any operation can be realized. Thus, Volcano is extensible with new operators, algorithms, data types, and type-specific methods. Volcano includes two novel meta-operators. The choose-plan meta-operator supports dynamic query evaluation plans that allow delaying selected optimization decisions until run-time, e.g., for embedded queries with free variables. The exchange meta-operator supports intra-operator parallelism on partitioned datasets and both vertical and horizontal inter-operator parallelism, translating between demand-driven dataflow within processes and data-driven dataflow between processes. All operators, with the exception of the exchange operator, have been designed and implemented in a single-process environment, and parallelized using the exchange operator. Even operators not yet designed can be parallelized using this new operator if they use and provide the interator interface. Thus, the issues of data manipulation and parallelism have become orthogonal, making Volcano the first implemented query execution engine that effectively combines extensibility and parallelism.</p>
query processing; parallel programming; resource allocation; data structures; Volcano; parallel query evaluation system; extensibility; database query processing; dataflow query execution system; query optimization; resource allocation; algebra operators; predicates; query processing operators; support functions; semantics; data type; type-specific methods.; novel meta-operators; choose-plan meta-operator; dynamic query evaluation plans; intra-operator parallelism; partitioned datasets; horizontal inter-operator parallelism; demand-driven dataflow; data-driven dataflow
G. Graefe, "Volcano— An Extensible and Parallel Query Evaluation System", IEEE Transactions on Knowledge & Data Engineering, vol. 6, no. , pp. 120-135, February 1994, doi:10.1109/69.273032
100 ms
(Ver 3.1 (10032016))