The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.08 - August (2006 vol.28)
pp: 1223-1235
ABSTRACT
Recent papers and patents in iterative unsupervised learning have emphasized a new trend in clustering. It basically consists of penalizing solutions via weights on the instance points, somehow making clustering move toward the hardest points to cluster. The motivations come principally from an analogy with powerful supervised classification methods known as boosting algorithms. However, interest in this analogy has so far been mainly borne out from experimental studies only. This paper is, to the best of our knowledge, the first attempt at its formalization. More precisely, we handle clustering as a constrained minimization of a Bregman divergence. Weight modifications rely on the local variations of the expected complete log-likelihoods. Theoretical results show benefits resembling those of boosting algorithms and bring modified (weighted) versions of clustering algorithms such as k\hbox{-}\rm means, fuzzy c\hbox{-}\rm means, Expectation Maximization (EM), and k\hbox{-}\rm harmonic means. Experiments are provided for all these algorithms, with a readily available code. They display the advantages that subtle data reweighting may bring to clustering.
INDEX TERMS
Clustering, Bregman divergences, k\hbox{-}\rm means, fuzzy k\hbox{-}\rm means, expectation maximization, harmonic means clustering.
CITATION
Richard Nock, Frank Nielsen, "On Weighting Clustering", IEEE Transactions on Pattern Analysis & Machine Intelligence, vol.28, no. 8, pp. 1223-1235, August 2006, doi:10.1109/TPAMI.2006.168
22 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool