The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.08 - August (2010 vol.32)
pp: 1426-1442
Liang Lin , Sun Yat-Sen University, Guangzhou
Xiaobai Liu , Lotus Hill Reseach Institute for Computer Vision and Information Science, Ezhou
Song-Chun Zhu , University of California, Los Angeles, Los Angeles
ABSTRACT
This paper presents a framework of layered graph matching for integrating graph partition and matching. The objective is to find an unknown number of corresponding graph structures in two images. We extract discriminative local primitives from both images and construct a candidacy graph whose vertices are matching candidates (i.e., a pair of primitives) and whose edges are either negative for mutual exclusion or positive for mutual consistence. Then we pose layered graph matching as a multicoloring problem on the candidacy graph and solve it using a composite cluster sampling algorithm. This algorithm assigns some vertices into a number of colors, each being a matched layer, and turns off all the remaining candidates. The algorithm iterates two steps: 1) Sampling the positive and negative edges probabilistically to form a composite cluster, which consists of a few mutually conflicting connected components (CCPs) in different colors and 2) assigning new colors to these CCPs with consistence and exclusion relations maintained, and the assignments are accepted by the Markov Chain Monte Carlo (MCMC) mechanism to preserve detailed balance. This framework demonstrates state-of-the-art performance on several applications, such as multi-object matching with large motion, shape matching and retrieval, and object localization in cluttered background.
INDEX TERMS
Graph matching, graph partitioning, DDMCMC, cluster sampling.
CITATION
Liang Lin, Xiaobai Liu, Song-Chun Zhu, "Layered Graph Matching with Composite Cluster Sampling", IEEE Transactions on Pattern Analysis & Machine Intelligence, vol.32, no. 8, pp. 1426-1442, August 2010, doi:10.1109/TPAMI.2009.150
REFERENCES
[1] A. Barbu and S.C. Zhu, "Generalizing Swendsen-Wang to Sampling Arbitrary Posterior Probabilities," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 27, no. 8, pp. 1239-1253, Aug. 2005.
[2] H. Bay, V. Ferraris, and L.V. Gool, "Wide Baseline Stereo Matching with Line Segments," Proc. IEEE Conf. Computer Vision and Pattern Recognition, vol. 1, pp. 329-336, 2005.
[3] S. Belongie, J. Malik, and J. Puzicha, "Shape Matching and Object Recognition Using Shape Contexts," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 24, no. 4, pp. 509-522, Apr. 2002.
[4] H. Chui and A. Rangarajan, "A New Point Matching Algorithm for Non-Rigid Registration," Computer Vision and Image Understanding, vol. 89, no. 2, pp. 114-141, 2003.
[5] I. Dryden and K. Mardia, Statistical Shape Analysis. John Wiley and Sons, 1998.
[6] R. Edwards and A. Sokal, "Generalization of the Fortuin- Kasteleyn-Swendsen-Wang Representation and Monte Carlo Algorithm," Physical Rev. D, vol. 38, no. 6, pp. 2009-2012, 1988.
[7] P.F. Felzenszwalb and J.D. Schwartz, "Hierarchical Matching of Deformable Shapes," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2007.
[8] R. Feris, R. Raskar, L. Chen, K. Tan, and M. Turk, "Discontinuity Preserving Stereo with Small Baseline Multi-Flash Illumination," Proc. IEEE Int'l Conf. Computer Vision, vol. 1, pp. 412-419, 2005.
[9] M.A. Fischler and R.C. Bolles, "Random Sample Consensus: A Paradigm for Model Fitting with Applications to Image Analysis and Automated Cartography," Comm. ACM, vol. 24, pp. 381-395, 1981.
[10] C.E. Guo, S.C. Zhu, and Y.N. Wu, "Primal Sketch: Integrating Texture and Structure," Computer Vision and Image Understanding, vol. 106, no. 1, pp. 5-19, 2007.
[11] L. Latecki, R. Lakamper, and T. Eckhardt, "Shape Descriptors for Non-Rigid Shapes with a Single Closed Contour," Proc. IEEE Conf. Computer Vision and Pattern Recognition, vol. 1, pp. 424-429, 2000.
[12] L. Lin, S.C. Zhu, and Y. Wang, "Layered Graph Match with Graph Editing," Proc. IEEE Conf. Computer Vision and Pattern Recognition, vol. 1, pp. 885-892, 2007.
[13] L. Lin, K. Zeng, X. Liu, and S.C. Zhu, "Layered Graph Matching by Composite Cluster Sampling with Collaborative and Competitive Interactions," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2009.
[14] L. Lin, S. Peng, J. Porway, S.C. Zhu, and Y. Wang, "An Empirical Study of Object Category Recognition: Sequential Testing with Generalized Samples," Proc. Int'l Conf. Computer Vision, vol. 1, pp. 419-426, 2007.
[15] H. Ling and D.W. Jacobs, "Shape Classification Using the Inner-Distance," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 29, no. 2, pp. 286-299, Feb. 2007.
[16] C. Liu, W.T. Freeman, and E.H. Adelson, "Analysis of Contour Motions," Advances in Neural Information Processing Systems, MIT Press, 2006.
[17] X. Liu, H. Li, W. Tao, and H. Jin, "Layered Shape Matching and Registration: Stochastic Sampling with Hierarchical Graph Representation," Proc. IEEE Conf. Pattern Recognition, 2008.
[18] D.G. Lowe, "Distinctive Image Features from Scale Invariant Keypoints," Int'l J. Computer Vision, vol. 60, no. 2, pp. 91-110, 2004.
[19] N. Metropolis, A.W. Rosenbluth, M.N. Rosenbluth, A.H. Teller, and E. Teller, "Equation of State Calculations by Fast Computing Machines," J. Chemical Physics, vol. 21, no. 6, pp. 85-111, 1953.
[20] D. Nister, "Preemptive RANSAC for Live Structure and Motion Estimation," Proc. Int'l Conf. Computer Vision, vol. 1, pp. 199-206, 2003.
[21] J. Porway and S.C. Zhu, "C4: Stochastic Inference in Graphical Models with Positive and Negative Edges," technical report, Dept. of Statistics, Univ. of California Los Angeles, www.stat.ucla.edu/~sczhu/papersC4_TR.pdf , Dec. 2008.
[22] T. Sebastian, P. Klein, and B. Kimia, "On Aligning Curves," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 25, no. 1, pp. 116-124, Jan. 2003.
[23] K. Siddiqi, A. Shokoufandeh, S.J. Dickenson, and S.W. Zucker, "Shock Graphs and Shape Matching," Proc. Int'l Conf. Computer Vision, vol. 1, pp. 222-229, 1998.
[24] D.G. Sim, K. Oh-Kyu, and P. Rae-Hong, "Object Matching Algorithms Using Robust Hausdorff Distance Measures," IEEE Trans. Image Processing, vol. 8, no. 3, pp. 425-429, 1999.
[25] J. Shi and C. Tomasi, "Good Features to Track," Proc. IEEE Conf. Computer Vision and Pattern Recognition, vol. 1, pp. 593-600, 1994.
[26] P. Smith, T. Drummond, and R. Cipolla, "Layered Motion Segmentation and Depth Ordering by Tracking Edges," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 26, no. 4, pp. 479-494, Apr. 2004.
[27] T.B. Sebastian, P.N. Klein, and B.B. Kimia, "Recognition of Shapes by Editing Their Shock Graphs," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 26, no. 5, pp. 550-571, May 2004.
[28] G.C. Sharp, S.W. Lee, and D.K. Wehe, "ICP Registration Using Invariant Features," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 24, no. 1, pp. 90-102, Jan. 2002.
[29] R.H. Swendsen and J.-S. Wang, "Nonuniversal Critical Dynamics in Monte Carlo Simulations," Physical Rev. Letters, vol. 58, no. 2, pp. 86-88, 1987.
[30] S. Todorovic and N. Ahuja, "Unsupervised Category Modeling, Recognition, and Segmentation in Images," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 30, no. 12, pp. 2158-2174, Dec. 2008.
[31] Z. Tu, S. Zheng, and A.L. Yuille, "Shape Matching and Registration by Data-Driven EM," Computer Vision and Image Understanding, vol. 103, no. 3, pp. 290-304, 2007.
[32] Z. Tu and S.C. Zhu, "Image Segmentation by Data-Driven Markov Chain Monte Carlo," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 24, no. 5, pp. 657-673, May 2002.
[33] Y. Weiss, "Smoothness in Layers: Motion Segmentation Using Nonparametric Mixture Estimation," Proc. IEEE Conf. Computer Vision and Pattern Recognition, vol. 1, pp. 520-526, 1997.
[34] Y. Weiss and E.H. Adelson, "Slow and Smooth: A Bayesian Theory for the Combination of Local Motion Signals in Human Vision," MIT Technical Report AI Memo 1624, 1998.
[35] J. Wills, S. Agarwal, and S. Belongie, "A Feature-Based Approach for Dense Segmentation and Estimation of Large Disparity Motion," Int'l J. Computer Vision, vol. 68, no. 2, pp. 125-143, 2006.
[36] B. Yao, X. Yang, and S.C. Zhu, "Introduction to a Large Scale General Purpose Groundtruth Dataset: Methodology, Annotation Tool, and Benchmarks," Proc. Int'l Conf. Energy Minimization Methods in Computer Vision and Pattern Recognition, pp. 169-183, 2007.
[37] S.C. Zhu and A.L. Yuille, "Forms: A Flexible Object Recognition and Modeling System," Int'l J. Computer Vision, vol. 20, no. 3, pp. 187-212, 1996.
30 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool