Issue No. 07 - July (2012 vol. 34)
Haifeng Liu , Zhejiang University, Hangzhou
Zhaohui Wu , Zhejiang University, Hangzhou
Thomas S. Huang , University of Illinois at Urbana-Champaign, Urbana
Deng Cai , Zhejiang University, Hangzhou
Nonnegative matrix factorization (NMF) is a popular technique for finding parts-based, linear representations of nonnegative data. It has been successfully applied in a wide range of applications such as pattern recognition, information retrieval, and computer vision. However, NMF is essentially an unsupervised method and cannot make use of label information. In this paper, we propose a novel semi-supervised matrix decomposition method, called Constrained Nonnegative Matrix Factorization (CNMF), which incorporates the label information as additional constraints. Specifically, we show how explicitly combining label information improves the discriminating power of the resulting matrix decomposition. We explore the proposed CNMF method with two cost function formulations and provide the corresponding update solutions for the optimization problems. Empirical experiments demonstrate the effectiveness of our novel algorithm in comparison to the state-of-the-art approaches through a set of evaluations based on real-world applications.
Nonnegative matrix factorization, semi-supervised learning, dimension reduction, clustering.
Haifeng Liu, Zhaohui Wu, Thomas S. Huang, Deng Cai, "Constrained Nonnegative Matrix Factorization for Image Representation", IEEE Transactions on Pattern Analysis & Machine Intelligence, vol. 34, no. , pp. 1299-1311, July 2012, doi:10.1109/TPAMI.2011.217