The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.05 - May (2010 vol.32)
pp: 861-874
Xingwei Yang , Temple University, Philadelphia
Longin Jan Latecki , Temple University, Philadelphia
Wenyu Liu , Huazhong University of Science and Technology, Wuhan
Zhuowen Tu , University of California, Los Angeles, Los Angeles
ABSTRACT
Shape similarity and shape retrieval are very important topics in computer vision. The recent progress in this domain has been mostly driven by designing smart shape descriptors for providing better similarity measure between pairs of shapes. In this paper, we provide a new perspective to this problem by considering the existing shapes as a group, and study their similarity measures to the query shape in a graph structure. Our method is general and can be built on top of any existing shape similarity measure. For a given similarity measure, a new similarity is learned through graph transduction. The new similarity is learned iteratively so that the neighbors of a given shape influence its final similarity to the query. The basic idea here is related to PageRank ranking, which forms a foundation of Google Web search. The presented experimental results demonstrate that the proposed approach yields significant improvements over the state-of-art shape matching algorithms. We obtained a retrieval rate of 91.61 percent on the MPEG-7 data set, which is the highest ever reported in the literature. Moreover, the learned similarity by the proposed method also achieves promising improvements on both shape classification and shape clustering.
INDEX TERMS
Shape similarity, shape retrieval, shape classification, shape clustering, graph transduction.
CITATION
Xingwei Yang, Longin Jan Latecki, Wenyu Liu, Zhuowen Tu, "Learning Context-Sensitive Shape Similarity by Graph Transduction", IEEE Transactions on Pattern Analysis & Machine Intelligence, vol.32, no. 5, pp. 861-874, May 2010, doi:10.1109/TPAMI.2009.85
REFERENCES
[1] S. Belongie, J. Malik, and J. Puzicha, "Shape Matching and Object Recognition Using Shape Contexts," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 24, no. 4, pp. 705-522, Apr. 2002.
[2] Z. Tu and A.L. Yuille, "Shape Matching and Recognition—Using Generative Models and Informative Features," Proc. Eighth European Conf. Computer Vision, pp. 195-209, 2004.
[3] H. Ling and D. Jacobs, "Shape Classification Using the Inner-Distance," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 29, no. 2,pp. 286-299, Feb. 2007.
[4] L.J. Latecki and R. Lakämper, "Shape Similarity Measure Based on Correspondence of Visual Parts," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 22, no. 10, pp. 1185-1190, Oct. 2000.
[5] X. Bai and L.J. Latecki, "Path Similarity Skeleton Graph Matching," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 30, no. 7, pp. 1282-1292, July 2008.
[6] B. Leibe and B. Schiele, "Analyzing Appearance and Contour Based Methods for Object Categorization," Proc. IEEE CS Conf. Computer Vision and Pattern Recognition, 2003.
[7] G. McNeill and S. Vijayakumar, "Hierarchical Procrustes Matching for Shape Retrieval," Proc. IEEE CS Conf. Computer Vision and Pattern Recognition, 2006.
[8] P.F. Felzenszwalb and J. Schwartz, "Hierarchical Matching of Deformable Shapes." Proc. IEEE CS Conf. Computer Vision and Pattern Recognition, 2007.
[9] T.B. Sebastian, P.N. Klein, and B.B. Kimia, "Recognition of Shapes by Editing Their Shock Graphs," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 25, no. 5, pp. 116-125, May 2004.
[10] K. Siddiqi, A. Shokoufandeh, S.J. Dickinson, and S.W. Zucker, "Shock Graphs and Shape Matching," Int'l J. Computer Vision, vol. 35, pp. 13-32, 1999.
[11] A. Shokoufandeh, D. Macrini, S. Dickinson, K. Siddiqi, and S.W. Zucker, "Indexing Hierarchical Structures Using Graph Spectra," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 27, no. 7, pp. 1125-1140, July 2005.
[12] L. Gorelick, M. Galun, E. Sharon, R. Basri, and A. Brandt, "Shape Representation and Classification Using the Poisson Equation," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 28, no. 12, pp. 1991-2005, Dec. 2006.
[13] I. Dryden, Statistical Shape Analysis. Wiley, 1998.
[14] F.L. Bookstein, "Principal Warps: Thin-Plate Splines and the Decomposition of Deformations," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 11, no. 6, pp. 567-585, June 1989.
[15] A. Srivastava, S. H. Joshi, W. Mio, and X. Liu, "Statistic Shape Analysis: Clustering, Learning, and Testing," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 27, no. 4, pp. 590-602, Apr. 2005.
[16] X. Zhu, "Semi-Supervised Learning with Graphs," doctoral dissertation, Carnegie Mellon Univ., CMU-LTI-05-192, 2005.
[17] J. Vleugels and R. Veltkamp, "Efficient Image Retrieval through Vantage Objects," Pattern Recognition, vol. 35, no. 1, pp. 69-80, 2002.
[18] L.J. Latecki, R. Lakämper, and U. Eckhardt, "Shape Descriptors for Non-Rigid Shapes with a Single Closed Contour," Proc. IEEE CS Conf. Computer Vision and Pattern Recognition, pp. 424-429, 2000.
[19] X. Yang, X. Bai, L.J. Latecki, and Z. Tu, "Improving Shape Retrieval by Learning Graph Transduction," Proc. European Conf. Computer Vision, 2008.
[20] U. Brefeld, C. Buscher, and T. Scheffer, "Multiview Dicriminative Sequential Learning," Proc. European Conf. Machine Learning, 2005.
[21] N.D. Lawrence and M.I. Jordan, "Semi-Supervised Learning via Gaussian Processes," Advances in Neural Information Processing Systems, MIT Press, 2004.
[22] T. Joachims, "Transductive Inference for Text Classification Using Support Vector Machines," Proc. Int'l Conf. Machine Learning, pp. 200-209, 1999.
[23] X. Zhu, Z. Ghahramani, and J. Lafferty, "Semi-Supervised Learning Using Gaussian Fields and Harmonic Functions," Proc. Int'l Conf. Machine Learning, 2003.
[24] D. Zhou, O. Bousquet, T.N. Lal, J. Weston, and B. Scholkopf, "Learning with Local and Global Consistency," Advances in Neural Information Processing Systems, MIT Press, 2003.
[25] F. Wang, J. Wang, C. Zhang, and H. Shen, "Semi-Supervised Classification Using Linear Neighborhood Propagation," Proc. IEEE CS Conf. Computer Vision and Pattern Recognition, 2006.
[26] D. Zhou, J. Weston, A. Gretton, Q. Bousquet, and B. Scholkopf, "Ranking on Data Manifolds," Advances in Neural Information Processing Systems, MIT Press, 2003.
[27] S.T. Roweis and L.K. Saul, "Nonlinear Dimensionality Reduction by Locally Linear Embedding," Science, vol. 290, pp. 2323-2326, 2000.
[28] X. Fan, C. Qi, D. Liang, and H. Huang, "Probabilistic Contour Extraction Using Hierarchical Shape Representation," Proc. IEEE Int'l Conf. Computer Vision, pp. 302-308, 2005.
[29] N. Alajlan, M. Kamel, and G. Freeman, "Geometry-Based Image Retrieval in Binary Image Databases," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 30, no. 6, pp. 1003-1013, June 2008.
[30] M. Daliri and V. Torre, "Robust Symbolic Representation for Shape Recognition and Retrieval," Pattern Recognition, vol. 41, no. 5, pp. 1799-1815, 2008.
[31] J. Yu, J. Amores, N. Sebe, P. Radeva, and Q. Tian, "Distance Learning for Similarity Estimation," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 30, pp. 451-462, Mar. 2008.
[32] E. Xing, A. Ng, M. Jordan, and S. Russell, "Distance Metric Learning with Application to Clustering with Side Information," Advances in Neural Information Processing Systems, pp. 505-512, MIT Press, 2003.
[33] A. Bar-Hillel, T. Hertz, N. Shental, and D. Weinshall, "Learning Distance Functions Using Equivalence Relations," Proc. Int'l Conf. Machine Learning, pp. 11-18, 2003.
[34] V. Athitsos, J. Alon, S. Sclaroff, and G. Kollios, "Bootmap: A Method for Efficient Approximate Similarity Rankings," Proc. IEEE CS Conf. Computer Vision and Pattern Recognition, 2004.
[35] T. Hertz, A. Bar-Hillel, and D. Weinshall, "Learning Distance Functions for Image Retrieval," Proc. IEEE CS Conf. Computer Vision and Pattern Recognition, pp. 570-577, 2004.
[36] L. Page, S. Brin, R. Motwani, and T. Winograd, "The Pagerank Citation Ranking: Bringing Order to the Web," Stanford Digital Libraries Working Paper, 1998.
[37] L. Zelnik-Manor and P. Perona, "Self-Tuning Spectral Clustering," Advances in Neural Information Processing Systems, MIT Press, 2004.
[38] M. Hein and M. Maier, "Manifold Denoising," Advances in Neural Information Processing Systems, MIT Press, 2006.
[39] J. Wang, S.-F. Chang, X. Zhou, and T.C.S. Wong, "Active Microscopic Cellular Image Annotation by Superposable Graph Transduction with Imbalanced Labels," Proc. IEEE CS Conf. Computer Vision and Pattern Recognition, 2008.
[40] F. Mokhtarian, F. Abbasi, and J. Kittler, "Efficient and Robust Retrieval by Shape Content through Curvature Scale Space," Image Databases and Multi-Media Search, A.W.M Smeulders and R. Jain, eds., pp. 51-58, World Scientific, 1997.
[41] T. Sebastian, P. Klein, and B. Kimia, "On Aligning Curves," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 25, no. 1, pp. 116-125, Jan. 2003.
[42] C. Grigorescu and N. Petkov, "Distance Sets for Shape Filters and Shape Recognition," IEEE Trans. Image Processing, vol. 12, no. 7, pp. 729-739, Oct. 2003.
[43] G. McNeill and S. Vijayakumar, "2d Shape Classification and Retrieval," Pro. Int'l Joint Conf. Artificial Intelligence, 2005.
[44] B. Super, "Learning Chance Probability Functions for Shape Retrieval or Classification," Proc. IEEE Workshop Learning at the IEEE CS Conf. Computer Vision and Pattern Recognition, 2004.
[45] J. Xie, P. Heng, and M. Shah, "Shape Matching and Modeling Using Skeletal Context," Pattern Recognition, vol. 41, no. 5, pp. 1756-1767, 2008.
[46] F. Mokhtarian and M. Bober, Curvature Scale Space Representation: Theory, Applications and MPEG-7 Standardization. Kluwer Academic, 2003.
[47] E. Attalla and P. Siy, "Robust Shape Similarity Retrieval Based on Contour Segmentation Polygonal Multiresolution and Elastic Matching," Pattern Recognition, vol. 38, no. 12, pp. 2229-2241, 2005.
[48] T. Adamek and N. O'Connor, "A Multiscale Representation Method for Nonrigid Shapes with a Single Closed Contour," IEEE Trans. Circuits and Systems for Video Technology, vol. 14, no. 5, pp. 742-753, May 2004.
[49] A. Peter, A. Rangarajan, and J. Ho, "Shape L'âne Rouge: Sliding Wavelets for Indexing and Retrieval," Proc. IEEE CS Conf. Computer Vision and Pattern Recognition, 2008.
[50] B. Super, "Retrieval from Shape Databases Using Chance Probability Functions and Fixed Correspondence," Int'l J. Pattern Recognition and Artificial Intelligence, vol. 20, no. 8, pp. 1117-1137, 2006.
[51] E. Keogh, "UCR Time Series Classification/Clustering Page," http://www.cs.ucr.edu/~amonntime_series_data /, 2009.
[52] C.A. Ratanamahatana and E. Keogh, "Three Myths About Dynamic Time Warping," Proc. SIAM Int'l Conf. Data Mining, pp. 506-510, 2005.
[53] O. Soderkvist, "Computer Vision Classification of Leaves from Swedish Trees," master's thesis, Linkoping Univ., 2001.
[54] A. Ghosh and N. Petkov, "Robustness of Shape Descriptors to Incomplete Contour Representations," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 27, no. 11, pp. 1793-1804, Nov. 2005.
[55] B.J. Frey and D. Dueck, "Clustering by Passing Messages between Data Points," Science, vol. 315, pp. 972-976, 2007.
52 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool