This Article 
 Bibliographic References 
 Add to: 
Probe Minimization by Schedule Optimization: Supporting Top-K Queries with Expensive Predicates
May 2007 (vol. 19 no. 5)
pp. 646-662
This paper addresses the problem of evaluating ranked top-k queries with expensive predicates. As major DBMSs now all support expensive user-defined predicates for Boolean queries, we believe such support for ranked queries will be even more important: First, ranked queries often need to model user-specific concepts of preference, relevance, or similarity, which call for dynamic user-defined functions. Second, middleware systems must incorporate external predicates for integrating autonomous sources typically accessible only by per-object queries. Third, ranked queries often accompany Boolean ranking conditions, which may turn predicates into expensive ones, as the index structure on the predicate built on the base table may be no longer effective in retrieving the filtered objects in order. Fourth, fuzzy joins are inherently expensive, as they are essentially user-defined operations that dynamically associate multiple relations. These predicates, being dynamically defined or externally accessed, cannot rely on index mechanisms to provide zero-time sorted output, and must instead require per-object probe to evaluate. To enable probe minimization, we develop the problem as cost-based optimization of searching over potential probe schedules. In particular, we decouple probe scheduling into object and predicate scheduling problems and develop an analytical object scheduling optimization and a dynamic predicate scheduling optimization, which combined together form a cost-effective probe schedule.
Index Terms:
Database query processing, distributed information systems, database systems.
Seung-won Hwang, Kevin Chen-Chuan Chang, "Probe Minimization by Schedule Optimization: Supporting Top-K Queries with Expensive Predicates," IEEE Transactions on Knowledge and Data Engineering, vol. 19, no. 5, pp. 646-662, May 2007, doi:10.1109/TKDE.2007.1007
Usage of this product signifies your acceptance of the Terms of Use.