CSDL Home IEEE Transactions on Pattern Analysis & Machine Intelligence 2009 vol.31 Issue No.09 - September

Subscribe

Issue No.09 - September (2009 vol.31)

pp: 1600-1615

Jingdong Wang , Microsoft Research Asia, Beijing

Fei Wang , Tsinghua University, Beijing

Changshui Zhang , Tsinghua University, Beijing

Helen C. Shen , The Hong Kong University of Science and Technology, Hong Kong

Long Quan , The Hong Kong University of Science and Technology, Hong Kong

ABSTRACT

In this paper, a novel graph-based transductive classification approach, called Linear Neighborhood Propagation, is proposed. The basic idea is to predict the label of a data point according to its neighbors in a linear way. This method can be cast into a second-order intrinsic Gaussian Markov random field framework. Its result corresponds to a solution to an approximate inhomogeneous biharmonic equation with Dirichlet boundary conditions. Different from existing approaches, our approach provides a novel graph structure construction method by introducing multiple-wise edges instead of pairwise edges, and presents an effective scheme to estimate the weights for such multiple-wise edges. To the best of our knowledge, these two contributions are novel for semi-supervised classification. The experimental results on image segmentation and transductive classification demonstrate the effectiveness and efficiency of the proposed approach.

INDEX TERMS

Gaussian Markov random fields, linear neighborhood propagation, transductive classification, image segmentation.

CITATION

Jingdong Wang, Fei Wang, Changshui Zhang, Helen C. Shen, Long Quan, "Linear Neighborhood Propagation and Its Applications",

*IEEE Transactions on Pattern Analysis & Machine Intelligence*, vol.31, no. 9, pp. 1600-1615, September 2009, doi:10.1109/TPAMI.2008.216REFERENCES

- [4] S. Barré, http://www.barre.nom.fr/medicalsamples, 2009.
- [6] M. Belkin, I. Matveeva, and P. Niyogi, “Regularization and Semi-Supervised Learning on Large Graphs,”
Proc. 17th Ann. Conf. Learning Theory, pp.624-638, 2004.- [7] M. Belkin and P. Niyogi, “Laplacian Eigenmaps and Spectral Techniques for Embedding and Clustering,”
Advances in Neural Information Processing Systems, vol. 14, pp.585-591, 2001.- [8] M. Belkin, P. Niyogi, and V. Sindhwani, “On Manifold Regularization,”
Proc. 10th Int'l Workshop Artificial Intelligence and Statistics, pp.17-24, 2005.- [9] A. Blum and S. Chawla, “Learning from Labeled and Unlabeled Data Using Graph Mincuts,”
Proc. 18th Int'l Conf. Machine Learning, pp.19-26, 2001.- [10] A. Blum, J.D. Lafferty, M.R. Rwebangira, and R. Reddy, “Semi-Supervised Learning Using Randomized Mincuts,”
Proc. 21st Int'l Conf. Machine Learning, 2004.- [12] Y. Boykov and M.-P. Jolly, “Interactive Graph Cuts for Optimal Boundary and Region Segmentation of Objects in N-D Images,”
Proc. Sixth Int'l Conf. Computer Vision, pp.105-112, 2001.- [13] O. Chapelle, J. Weston, and B. Schölkopf, “Cluster Kernels for Semi-Supervised Learning,”
Advances in Neural Information Processing Systems, vol. 15, pp.585-592, 2002.- [14] O. Delalleau, Y. Bengio, and N.L. Roux, “Efficient Non-Parametric Function Induction in Semi-Supervised Learning,”
Proc. 10th Int'l Workshop Artificial Intelligence and Statistics, pp.96-103, 2005.- [15] A. Fujino, N. Ueda, and K. Saito, “A Hybrid Generative/Discriminative Approach to Semi-Supervised Classifier Design,”
Proc. 20th Nat'l Conf. Artificial Intelligence, pp.764-769, 2005.- [16] L. Grady, “Multilabel Random Walker Image Segmentation Using Prior Models,”
Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp.763-770, 2005.- [18] L. Grady, T. Schiwietz, S. Aharon, and R. Westermann, “Random Walks for Interactive Alpha-Matting,”
Proc. Fifth IASTED Int'l Conf. Visualization, Imaging, and Image Processing, pp.423-429, 2005.- [19] J. He, M. Li, H. Zhang, H. Tong, and C. Zhang, “Manifold-Ranking Based Image Retrieval,”
Proc. 12th ACM Int'l Conf. Multimedia, pp.9-16, 2004.- [20] T. Joachims, “Transductive Inference for Text Classification Using Support Vector Machines,”
Proc. 16th Int'l Conf. Machine Learning, pp.200-209, 1999.- [21] T. Joachims, “Transductive Learning via Spectral Graph Partitioning,”
Proc. 20th Int'l Conf. Machine Learning, pp.290-297, 2003.- [22] M.I. Jordan, Z. Ghahramani, T. Jaakkola, and L.K. Saul, “An Introduction to Variational Methods for Graphical Models,”
Machine Learning, vol. 37, no. 2, pp.183-233, 1999.- [23] V. Kolmogorov and R. Zabih, “Multi-Camera Scene Reconstruction via Graph Cuts,”
Proc. Seventh European Conf. Computer Vision, pp.82-96, 2002.- [24] V. Kwatra, A. Schödl, I.A. Essa, G. Turk, and A.F. Bobick, “Graphcut Textures: Image and Video Synthesis Using Graph Cuts,”
ACM Trans. Graphics, vol. 22, no. 3, pp.277-286, 2003.- [28] D.R. Martin, C. Fowlkes, D. Tal, and J. Malik, “A Database of Human Segmented Natural Images and Its Application to Evaluating Segmentation Algorithms and Measuring Ecological Statistics,”
Proc. Eighth Int'l Conf. Computer Vision, pp.416-425, 2001.- [29] S.A. Nene, S.K. Nayar, and H. Murase, “Columbia Object Image Library: COIL-20,” technical report, Dept. of Computer Science, Columbia Univ., 1996.
- [30] K. Nigam, “Using Unlabeled Data to Improve Text Classification,” PhD dissertation, Dept. of Computer Science, Carnegie Mellon Univ., 2001.
- [31] J. Nocedal and S.J. Wright,
Numerical Optimization. Springer-Verlag, 2006.- [33] C. Rother, V. Kolmogorov, and A. Blake, “‘GrabCut’: Interactive Foreground Extraction Using Iterated Graph Cuts,”
ACM Trans. Graphics, vol. 23, no. 3, pp.309-314, 2004.- [35] H. Rue and L. Held,
Gaussian Markov Random Fields: Theory and Applications. Chapman & Hall, 2005.- [36] F. Samaria and A. Harter, “Parameterisation of a Stochastic Model for Human Face Identification,”
Proc. IEEE Workshop Applications of Computer Vision, Dec. 1994.- [37] L.K. Saul and S.T. Roweis, “Think Globally, Fit Locally: Unsupervised Learning of Low Dimensional Manifold,”
J.Machine Learning Research, vol. 4, pp.119-155, 2003.- [41] Q. Wu, W. Dou, Y. Chen, and J.-M. Constans, “Fuzzy Segementaion of Cerebral Tumorous Tissues in MR Images via Support Vector Machine and Fuzzy Clustering,”
Proc. 11th World Congress of Int'l Fuzzy Systems Assoc., 2005.- [43] D. Zhou, O. Bousquet, T.N. Lal, J. Weston, and B. Schölkopf, “Learning with Local and Global Consistency,”
Advances in Neural Information Processing Systems, vol. 16, 2003.- [44] D. Zhou, J. Huang, and B. Schölkopf, “Learning with Hypergraphs: Clustering, Classification, and Embedding,”
Advances in Neural Information Processing Systems, vol. 19, pp.1601-1608, 2006.- [45] D. Zhou and B. Schölkopf, “Learning from Labeled and Unlabeled Data Using Random Walks,”
Proc. 26th DAGM Symp. Pattern Recognition, pp.237-244, 2004.- [46] X. Zhu, “Semi-Supervised Learning Literature Survey,” Technical Report 1530, Dept. of Computer Sciences, Univ. of Wisconsin-Madison, 2006.
- [47] X. Zhu, Z. Ghahramani, and J. Lafferty, “Semi-Supervised Learning Using Gaussian Fields and Harmonic Functions,”
Proc. 20th Int'l Conf. Machine Learning, pp.912-919, 2003. |