This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Active Learning of Constraints for Semi-Supervised Clustering
Jan. 2014 (vol. 26 no. 1)
pp. 43-54
Sicheng Xiong, Oregon State University, Corvallis
Javad Azimi, InsightsOne Inc., Santa Clara
Xiaoli Z. Fern, Oregon State University, Corvallis
Semi-supervised clustering aims to improve clustering performance by considering user supervision in the form of pairwise constraints. In this paper, we study the active learning problem of selecting pairwise must-link and cannot-link constraints for semi-supervised clustering. We consider active learning in an iterative manner where in each iteration queries are selected based on the current clustering solution and the existing constraint set. We apply a general framework that builds on the concept of neighborhood, where neighborhoods contain "labeled examples" of different clusters according to the pairwise constraints. Our active learning method expands the neighborhoods by selecting informative points and querying their relationship with the neighborhoods. Under this framework, we build on the classic uncertainty-based principle and present a novel approach for computing the uncertainty associated with each data point. We further introduce a selection criterion that trades off the amount of uncertainty of each data point with the expected number of queries (the cost) required to resolve this uncertainty. This allows us to select queries that have the highest information rate. We evaluate the proposed method on the benchmark data sets and the results demonstrate consistent and substantial improvements over the current state of the art.
Index Terms:
Uncertainty,Nickel,Measurement uncertainty,Current measurement,Clustering algorithms,Probabilistic logic,Supervised learning,semi-supervised learning,Active learning,clustering
Citation:
Sicheng Xiong, Javad Azimi, Xiaoli Z. Fern, "Active Learning of Constraints for Semi-Supervised Clustering," IEEE Transactions on Knowledge and Data Engineering, vol. 26, no. 1, pp. 43-54, Jan. 2014, doi:10.1109/TKDE.2013.22
Usage of this product signifies your acceptance of the Terms of Use.