This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Robust Dense Registration of Partial Nonrigid Shapes
Aug. 2012 (vol. 18 no. 8)
pp. 1268-1280
Tingbo Hou, Dept. of Comput. Sci., Stony Brook Univ., Stony Brook, NY, USA
Hong Qin, Dept. of Comput. Sci., Stony Brook Univ., Stony Brook, NY, USA
This paper presents a complete and robust solution for dense registration of partial nonrigid shapes. Its novel contributions are founded upon the newly proposed heat kernel coordinates (HKCs) that can accurately position points on the shape, and the priority-vicinity search that ensures geometric compatibility during the registration. HKCs index points by computing heat kernels from multiple sources, and their magnitudes serve as priorities of queuing points in registration. We start with shape features as the sources of heat kernels via feature detection and matching. Following the priority order of HKCs, the dense registration is progressively propagated from feature sources to all points. Our method has a superior indexing ability that can produce dense correspondences with fewer flips. The diffusion nature of HKCs, which can be interpreted as a random walk on a manifold, makes our method robust to noise and small holes avoiding surface surgery and repair. Our method searches correspondence only in a small vicinity of registered points, which significantly improves the time performance. Through comprehensive experiments, our new method has demonstrated its technical soundness and robustness by generating highly compatible dense correspondences.

[1] V. Jain and H. Zhang, "Robust 3D Shape Correspondence in the Spectral Domain," Proc. IEEE Int'l Conf. Shape Modeling and Applications (SMI), p. 19, 2006.
[2] Q.-X. Huang, B. Adams, M. Wicke, and L.J. Guibas, "Non-Rigid Registration under Isometric Deformations," Computer Graphics Forum, vol. 27, no. 5, pp. 1449-1457, 2008.
[3] Y. Lipman and T. Funkhouser, "Möbius Voting for Surface Correspondence," ACM Trans. Graphics, vol. 28, no. 3, pp. 72:1-72:12, 2009.
[4] O.K.-C. Au, C.-L. Tai, D. Cohen-Or, Y. Zheng, and H. Fu, "Electors Voting for Fast Automatic Shape Correspondence," Computer Graphics Forum, vol. 29, no. 2, pp. 645-654, 2010.
[5] T.K. Dey, K. Li, C. Luo, P. Ranjan, I. Safa, and Y. Wang, "Persistent Heat Signature for Pose-Oblivious Matching of Incomplete Models," Computer Graphics Forum, vol. 29, no. 5, pp. 1545-1554, 2010.
[6] M. Ovsjanikov, Q. Mérigot, F. Mémoli, and L. Guibas, "One Point Isometric Matching with the Heat Kernel," Computer Graphics Forum, vol. 29, no. 5, pp. 1555-1564, 2010.
[7] M.R. Ruggeri, G. Patanè, M. Spagnuolo, and D. Saupe, "Spectral-Driven Isometry-Invariant Matching of 3D Shapes," Int'l J. Computer Vision, vol. 89, nos. 2/3, pp. 248-265, 2010.
[8] J. Sun, X. Chen, and T.A. Funkhouser, "Fuzzy Geodesics and Consistent Sparse Correspondences for Deformable Shapes," Computer Graphics Forum, vol. 29, no. 5, pp. 1535-1544, 2010.
[9] O. van Kaick, H. Zhang, G. Hamarneh, and D. Cohen-Or, "A Survey on Shape Correspondence," Proc. Eurographics State-of-The-Art Report, pp. 1-24, 2010.
[10] M. Reuter, F.-E. Wolter, and N. Peinecke, "Laplace-Beltrami Spectra as "Shape-Dna" of Surfaces and Solids," Computer-Aided Design, vol. 38, no. 4, pp. 342-366, 2006.
[11] R.M. Rustamov, "Laplace-Beltrami Eigenfunctions for Deformation Invariant Shape Representation," Proc. Fifth Eurographics Symp. Geometry Processing (SGP '07), pp. 225-233, 2007.
[12] T. Ju, S. Schaefer, and J. Warren, "Mean Value Coordinates for Closed Triangular Meshes," ACM Trans. Graphics, vol. 24, no. 3, pp. 561-566, 2005.
[13] P. Joshi, M. Meyer, T. De Rose, B. Green, and T. Sanocki, "Harmonic Coordinates for Character Articulation," ACM Trans. Graphics, vol. 26, no. 3, pp. 71:1-71:9, 2007.
[14] P.W. Jones, M. Maggioni, and R. Schul, "Manifold Parameterizations by Eigenfunctions of the Laplacian and Heat Kernels," Proc. Nat'l Academy of Sciences of USA, vol. 105, no. 6, pp. 1803-1808, 2008.
[15] T. Hou and H. Qin, "Efficient Computation of Scale-Space Features for Deformable Shape Correspondences," Proc. 11th European Conf. Computer Vision (ECCV), pp. 384-397, 2010.
[16] Y. Zeng, C. Wang, Y. Wang, X. Gu, D. Samaras, and N. Paragios, "Dense Non-Rigid Surface Registration Using High-Order Graph Matching," Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR), pp. 382-389, 2010.
[17] J. Sun, M. Ovsjanikov, and L. Guibas, "A Concise and Provably Informative Multi-Scale Signature Based on Heat Diffusion," Computer Graphics Forum, vol. 28, no. 5, pp. 1383-1392, 2009.
[18] M. Leordeanu and M. Hebert, "A Spectral Technique for Correspondence Problems Using Pairwise Constraints," Proc. IEEE 10th Int'l Conf. Computer Vision (ICCV), pp. 1482-1489, 2005.
[19] X. Gu, S. Wang, J. Kim, Y. Zeng, Y. Wang, H. Qin, and D. Samaras, "Ricci Flow for 3D Shape Analysis," Proc. IEEE 11th Int'l Conf. Computer Vision (ICCV), 2007.
[20] J. Novatnack and K. Nishino, "Scale-Dependent 3D Geometric Features," Proc. IEEE 11th Int'l Conf. Computer Vision (ICCV), pp. 1-8, 2007.
[21] C.H. Lee, A. Varshney, and D.W. Jacobs, "Mesh Saliency," ACM Trans. Graphics, vol. 24, no. 3, pp. 659-666, 2005.
[22] R. Gal and D. Cohen-Or, "Salient Geometric Features for Partial Shape Matching and Similarity," ACM Trans. Graphics, vol. 25, no. 1, pp. 130-150, 2006.
[23] J. Hua, Z. Lai, M. Dong, X. Gu, and H. Qin, "Geodesic Distance-Weighted Shape Vector Image Diffusion," IEEE Trans. Visualization and Computer Graphics, vol. 14, no. 6, pp. 1643-1650, Nov./Dec. 2008.
[24] G. Zou, J. Hua, Z. Lai, X. Gu, and M. Dong, "Intrinsic Geometric Scale Space by Shape Diffusion," IEEE Trans. Visualization and Computer Graphics, vol. 15, no. 6, pp. 1193-1200, Nov./Dec. 2009.
[25] A. Vaxman, M. Ben-Chen, and C. Gotsman, "A Multi-Resolution Approach to Heat Kernels on Discrete Surfaces," ACM Trans. Graphics, vol. 29, no. 4, pp. 121:1-121:10, 2010.
[26] G. Patanè and B. Falcidieno, "Multi-Scale Feature Spaces for Shape Processing and Analysis," Proc. Shape Modeling Int'l Conf. (SMI '10), pp. 113-123, 2010.
[27] A. Dubrovina and R. Kimmel, "Matching Shapes by Eigendecomposition of the Laplace-Beltrami Operator," Proc. 3D Data Processing, Visualization and Transmission, 2010.
[28] A.M. Bronstein, M.M. Bronstein, M. Mahmoudi, R. Kimmel, and G. Sapiro, "A Gromov-Hausdorff Framework with Diffusion Geometry for Topological-Robust Non-Rigid Shape Matching," Int'l J. Computer Vision, vol. 89, nos. 2/3, pp. 266-286, 2010.
[29] M.M. Bronstein and A.M. Bronstein, "Shape Recognition with Spectral Distances," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 33, no. 5, pp. 1065-1071, May 2011.
[30] D. Raviv, A.M. Bronstein, M.M. Bronstein, R. Kimmel, and N. Sochen, "Affine-Invariant Diffusion Geometry for the Analysis of Deformable 3D Shapes," Computers & Graphics, vol. 35, no. 3, pp. 692-697, 2011.
[31] T. Cour, P. Srinivasan, and J. Shi, "Balanced Graph Matching," Proc. Conf. Neural Information Processing Systems, pp. 313-320, 2006.
[32] L. Torresani, V. Kolmogorov, and C. Rother, "Feature Correspondence via Graph Matching," Proc. 10th European Conf. Computer Vision, pp. 596-609, 2008.
[33] O. Duchenne, F. Bach, I. Kweon, and J. Ponce, "A Tensor-Based Algorithm for High-Order Graph Matching," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 1980-1987, 2009.
[34] W. Chang and M. Zwicker, "Automatic Registration for Articulated Shapes," Computer Graphics Forum, vol. 27, no. 5, pp. 1459-1468, 2008.
[35] V. Kraevoy and A. Sheffer, "Cross-Parameterization and Compatible Remeshing of 3D Models," ACM Trans. Graphics, vol. 23, no. 3, pp. 861-869, 2004.
[36] V. Jain, H. Zhang, and O. van Kaick, "Non-Rigid Spectral Correspondence of Triangle Meshes," Int'l J. Computer Vision, vol. 13, no. 1, pp. 101-124, 2007.
[37] D. Mateus, R. Horaud, D. Knossow, F. Cuzzolin, and E. Boyer, "Articulated Shape Matching Using Laplacian Eigenfunctions and Unsupervised Point Registration," Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR), pp. 1-8, 2008.
[38] M. Reuter, F.-E. Wolter, M. Shenton, and M. Niethammer, "Laplace-Beltrami Eigenvalues and Topological Features of Eigenfunctions for Statistical Shape Analysis," Computer-Aided Design, vol. 41, no. 10, pp. 739-755, 2009.
[39] N. Ahmed, C. Theobalt, C. Rössl, S. Thrun, and H.-P. Seidel, "Dense Correspondence Finding for Parametrization-Free Animation Reconstruction from Video," Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR), pp. 1-8, 2008.
[40] A.M. Bronstein, M.M. Bronstein, and R. Kimmel, "Generalized Multidimensional Scaling: A Framework for Isometry-Invariant Partial Surface Matching," Proc. Nat'l Academy of Sciences of USA, vol. 103, no. 5, pp. 1168-1172, 2006.
[41] A. Tevs, M. Bokeloh, and M. Wand, "Isometric Registration of Ambiguous and Partial Data," Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR), pp. 1185-1192, 2009.
[42] A. Grigor'yan, "Heat Kernels on Weighted Manifolds and Applications," Contemporary Math., vol. 398, pp. 93-191, 2006.
[43] R. Liu and H. Zhang, "Mesh Segmentation via Spectral Embedding and Contour Analysis," Computer Graphics Forum, vol. 26, no. 3, pp. 385-394, 2007.
[44] F. de Goes, S. Goldenstein, and L. Velho, "A Hierarchical Segmentation of Articulated Bodies," Computer Graphics Forum, vol. 27, no. 5, pp. 1349-1356, 2008.
[45] M. Reuter, "Hierarchical Shape Segmentation and Registration via Topological Features of Laplace-Beltrami Eigenfunctions," Int'l J. Computer Vision, vol. 89, no. 2, pp. 287-308, 2010.
[46] M. Meyer, M. Desbrun, P. Schröder, and A.H. Barr, "Discrete Differential-Geometry Operators for Triangulated 2-Manifolds," Visualization and Math., vol. 3, no. 7, pp. 35-57, 2002.
[47] A. Grigor'yan and L. Saloff-Coste, "Heat Kernel on Manifolds with Ends," Annales de l'institut Fourier, vol. 59, no. 5, pp. 1917-1997, 2009.
[48] L. Saloff-Coste, "The Heat Kernel and its Estimates," Advanced Studies in Pure Math., vol. 57, 2010.
[49] R.R. Coifman, S. Lafon, A.B. Lee, M. Maggioni, B. Nadler, F. Warner, and S.W. Zucker, "Geometric Diffusions as a Tool Fro Harmonic Analysis and Structure Definition of Data: Diffusion Maps," Proc. Nat'l Academy of Sciences of USA, vol. 102, no. 21, pp. 7426-7431, 2005.
[50] A. Grigor'yan, "Escape Rate of Brownian Motion on Riemannian Manifolds," Applicable Analysis, vol. 71, no. 1, pp. 63-89, 1999.
[51] R.W. Sumner and J. Popović, "Deformation Transfer for Triangle Meshes," ACM Trans. Graphics, vol. 23, no. 3, pp. 399-405, 2004.
[52] L. Zhang, N. Snavely, B. Curless, and S. Seitz, "Spacetime Faces: High-Resolution Capture for Modeling and Animation," ACM Trans. Graphics, vol. 23, no. 3, pp. 548-558, 2004.
[53] S. Wang, X. Gu, and H. Qin, "Automatic Non-Rigid Registration of 3D Dynamic Data for Facial Expression Synthesis and Transfer," Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR), pp. 1-8, 2008.
[54] D. Vlasic, I. Baran, W. Matusik, and J. Popović, "Articulated Mesh Animation from Multi-View Silhouettes," ACM Trans. Graphics, vol. 27, no. 3, pp. 97:1-97:9, 2008.

Index Terms:
solid modelling,feature extraction,geometry,image matching,image registration,object detection,random processes,search problems,shape recognition,random walk,robust dense registration,partial nonrigid shape,heat kernel coordinates,priority-vicinity search,geometric compatibility,HKC index point,magnitude,queuing point,shape feature,feature detection,feature matching,feature source propagation,Shape,Heating,Kernel,Manifolds,Eigenvalues and eigenfunctions,Feature extraction,Robustness,heat kernel coordinates.,Dense registration,partial nonrigid shape
Citation:
Tingbo Hou, Hong Qin, "Robust Dense Registration of Partial Nonrigid Shapes," IEEE Transactions on Visualization and Computer Graphics, vol. 18, no. 8, pp. 1268-1280, Aug. 2012, doi:10.1109/TVCG.2011.267
Usage of this product signifies your acceptance of the Terms of Use.