The Community for Technology Leaders
2013 IEEE 29th International Conference on Data Engineering (ICDE) (2002)
San Jose, California
Feb. 26, 2002 to Mar. 1, 2002
ISBN: 0-7695-1531-2
pp: 0517
Wei Wang , IBM T.J. Watson Research Centers
Haixun Wang , IBM T.J. Watson Research Centers
Jiong Yang , IBM T.J. Watson Research Centers
Philip Yu , IBM T.J. Watson Research Centers
ABSTRACT
Clustering has been an active research area of great practical importance for recent years. Most previous clustering models have focused on grouping objects with similar values on a (sub)set of dimensions (e.g., subspace cluster) and assumed that every object has an associated value on every dimension (e.g., bicluster). These existing cluster models may not always be adequate in capturing coherence exhibited among objects. Strong coherence may still exist among a set of objects (on a subset of attributes) even if they take quite different values on each attribute and the attribute values are not fully specified.This is very common in many applications including bio-informatics analysis as well as collaborative filtering analysis, where the data may be incomplete and subject to biases. In bio-informatics, a bicluster model has recently been proposed to capture coherence among a subset of the attributes. Here, we introduce a more general model, referred to as the delta-cluster model, to capture coherence exhibited by a subset of objects on a subset of attributes, while allowing absent attribute values. A move-based algorithm (FLOC) is devised to efficiently produce a near-optimal clustering results.The delta-cluster model takes the bicluster model as a special case,where the FLOC algorithm performs far superior to the bicluster algorithm. We demonstrate the correctness and efficiency of the delta-cluster model and the FLOC algorithm on a number of real and synthetic data sets.
INDEX TERMS
Clustering, Collaborative Filtering, Bio-informatics, Microarray Analysis, Incomplete Data Analysis
CITATION
Wei Wang, Haixun Wang, Jiong Yang, Philip Yu, "d-Clusters: Capturing Subspace Correlation in a Large Data Set", 2013 IEEE 29th International Conference on Data Engineering (ICDE), vol. 00, no. , pp. 0517, 2002, doi:10.1109/ICDE.2002.994771
94 ms
(Ver 3.3 (11022016))