Apr. 7, 2008 to Apr. 12, 2008
Charu C. Aggarwal , IBM T. J. Watson Research Center, 19 Skyline Drive, Hawthorne, NY 10532, USA. firstname.lastname@example.org
Philip S. Yu , IBM T. J. Watson Research Center, 19 Skyline Drive, Hawthorne, NY 10532, USA. email@example.com
In this paper, we will examine the problem of distance function computation and indexing uncertain data in high dimensionality for nearest neighbor and range queries. Because of the inherent noise in uncertain data, traditional distance function measures such as the L<inf>q</inf>-metric and their probabilistic variants are not qualitatively effective. This problem is further magnified by the sparsity issue in high dimensionality. In this paper, we examine methods of computing distance functions for high dimensional data which are qualitatively effective and friendly to the use of indexes. In this paper, we show how to construct an effective index structure in order to handle uncertain similarity and range queries in high dimensionality. Typical range queries in high dimensional space use only a subset of the ranges in order to resolve the queries. Furthermore, it is often desirable to run similarity queries with only a subset of the large number of dimensions. Such queries are difficult to resolve with traditional index structures which use the entire set of dimensions. We propose query-processing techniques which use effective search methods on the index in order to compute the final results. We discuss the experimental results on a number of real and synthetic data sets in terms of effectiveness and efficiency. We show that the proposed distance measures are not only more effective than traditional L<inf>q</inf>-norms, but can also be computed more efficiently over our proposed index structure.
Charu C. Aggarwal, Philip S. Yu, "On High Dimensional Indexing of Uncertain Data", ICDE, 2008, 2013 IEEE 29th International Conference on Data Engineering (ICDE), 2013 IEEE 29th International Conference on Data Engineering (ICDE) 2008, pp. 1460-1461, doi:10.1109/ICDE.2008.4497589