The Community for Technology Leaders
2013 IEEE 29th International Conference on Data Engineering (ICDE) (2006)
Atlanta, Georgia
Apr. 3, 2006 to Apr. 7, 2006
ISBN: 0-7695-2570-9
pp: 8
Sudipto Guha , U of Pennsylvania
Xiaohui Yu , U of Toronto
Nick Koudas , U of Toronto
Divesh Srivastava , AT&T Labs Research
ABSTRACT
Join techniques deploying approximate match predicates are fundamental data cleaning operations. A variety of predicates have been utilized to quantify approximate match in such operations and some have been embedded in a declarative data cleaning framework. These techniques return pairs of tuples from both relations, tagged with a score, signifying the degree of similarity between the tuples in the pair according to the specific approximate match predicate. <p>In this paper, we consider the problem of estimating various parameters on the output of declarative approximate join algorithms for planning purposes. Such algorithms are highly time consuming, so precise knowledge of the result size as well as its score distribution is a pressing concern. This knowledge aids decisions as to which operations are more promising for identifying highly similar tuples, which is a key operation for data cleaning. We propose solution strategies that fully comply with a declarative framework and analytically reason about the quality of the estimates we obtain as well as the performance of our strategies.</p> <p>We present the results of a detailed performance evaluation of all strategies proposed. Our experimental results validate our analytical expectations and shed additional light on the quality and performance of our estimation framework. Our study offers a set of simple, fully declarative techniques for this problem, which can be readily deployed in data cleaning systems.</p>
INDEX TERMS
null
CITATION
Sudipto Guha, Xiaohui Yu, Nick Koudas, Divesh Srivastava, "Reasoning About Approximate Match Query Results", 2013 IEEE 29th International Conference on Data Engineering (ICDE), vol. 00, no. , pp. 8, 2006, doi:10.1109/ICDE.2006.128
100 ms
(Ver )