The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.05 - September/October (2003 vol.15)
pp: 1170-1187
George Kollios , IEEE Computer Society
ABSTRACT
<p><b>Abstract</b>—We investigate the use of biased sampling according to the density of the data set to speed up the operation of general data mining tasks, such as clustering and outlier detection in large multidimensional data sets. In density-biased sampling, the probability that a given point will be included in the sample depends on the local density of the data set. We propose a general technique for density-biased sampling that can factor in user requirements to sample for properties of interest and can be tuned for specific data mining tasks. This allows great flexibility and improved accuracy of the results over simple random sampling. We describe our approach in detail, we analytically evaluate it, and show how it can be optimized for approximate clustering and outlier detection. Finally, we present a thorough experimental evaluation of the proposed method, applying density-biased sampling on real and synthetic data sets, and employing clustering and outlier detection algorithms, thus highlighting the utility of our approach.</p>
INDEX TERMS
Data mining, sampling, clustering, outlier detection.
CITATION
George Kollios, Dimitrios Gunopulos, Nick Koudas, Stefan Berchtold, "Efficient Biased Sampling for Approximate Clustering and Outlier Detection in Large Data Sets", IEEE Transactions on Knowledge & Data Engineering, vol.15, no. 5, pp. 1170-1187, September/October 2003, doi:10.1109/TKDE.2003.1232271
25 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool