2013 IEEE 29th International Conference on Data Engineering (ICDE) (2002)

San Jose, California

Feb. 26, 2002 to Mar. 1, 2002

ISBN: 0-7695-1531-2

pp: 0517

Wei Wang , IBM T.J. Watson Research Centers

Haixun Wang , IBM T.J. Watson Research Centers

Jiong Yang , IBM T.J. Watson Research Centers

Philip Yu , IBM T.J. Watson Research Centers

ABSTRACT

Clustering has been an active research area of great practical importance for recent years. Most previous clustering models have focused on grouping objects with similar values on a (sub)set of dimensions (e.g., subspace cluster) and assumed that every object has an associated value on every dimension (e.g., bicluster). These existing cluster models may not always be adequate in capturing coherence exhibited among objects. Strong coherence may still exist among a set of objects (on a subset of attributes) even if they take quite different values on each attribute and the attribute values are not fully specified.This is very common in many applications including bio-informatics analysis as well as collaborative filtering analysis, where the data may be incomplete and subject to biases. In bio-informatics, a bicluster model has recently been proposed to capture coherence among a subset of the attributes. Here, we introduce a more general model, referred to as the delta-cluster model, to capture coherence exhibited by a subset of objects on a subset of attributes, while allowing absent attribute values. A move-based algorithm (FLOC) is devised to efficiently produce a near-optimal clustering results.The delta-cluster model takes the bicluster model as a special case,where the FLOC algorithm performs far superior to the bicluster algorithm. We demonstrate the correctness and efficiency of the delta-cluster model and the FLOC algorithm on a number of real and synthetic data sets.

INDEX TERMS

Clustering, Collaborative Filtering, Bio-informatics, Microarray Analysis, Incomplete Data Analysis

CITATION

Wei Wang,
Haixun Wang,
Jiong Yang,
Philip Yu,
"d-Clusters: Capturing Subspace Correlation in a Large Data Set",

*2013 IEEE 29th International Conference on Data Engineering (ICDE)*, vol. 00, no. , pp. 0517, 2002, doi:10.1109/ICDE.2002.994771