The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.09 - Sept. (2013 vol.35)
pp: 2143-2160
H. Lombaert , Centre for Intell. Machines, McGill Univ., Montreal, QC, Canada
L. Grady , HeartFlow, Redwood, CA, USA
J. R. Polimeni , Dept. of Radiol., Massachusetts Gen. Hosp., Charlestown, MA, USA
F. Cheriet , Ecole Polytech. de Montreal, Montreal, QC, Canada
ABSTRACT
Existing methods for surface matching are limited by the tradeoff between precision and computational efficiency. Here, we present an improved algorithm for dense vertex-to-vertex correspondence that uses direct matching of features defined on a surface and improves it by using spectral correspondence as a regularization. This algorithm has the speed of both feature matching and spectral matching while exhibiting greatly improved precision (distance errors of 1.4 percent). The method, FOCUSR, incorporates implicitly such additional features to calculate the correspondence and relies on the smoothness of the lowest-frequency harmonics of a graph Laplacian to spatially regularize the features. In its simplest form, FOCUSR is an improved spectral correspondence method that nonrigidly deforms spectral embeddings. We provide here a full realization of spectral correspondence where virtually any feature can be used as an additional information using weights on graph edges, but also on graph nodes and as extra embedded coordinates. As an example, the full power of FOCUSR is demonstrated in a real-case scenario with the challenging task of brain surface matching across several individuals. Our results show that combining features and regularizing them in a spectral embedding greatly improves the matching precision (to a submillimeter level) while performing at much greater speed than existing methods.
INDEX TERMS
Laplace equations, Shape, Surface treatment, Harmonic analysis, Brain, Computational modeling, Spectral analysis,graph theory, Registration, surface fitting, spectral methods
CITATION
H. Lombaert, L. Grady, J. R. Polimeni, F. Cheriet, "FOCUSR: Feature Oriented Correspondence Using Spectral Regularization--A Method for Precise Surface Matching", IEEE Transactions on Pattern Analysis & Machine Intelligence, vol.35, no. 9, pp. 2143-2160, Sept. 2013, doi:10.1109/TPAMI.2012.276
REFERENCES
[1] B. Allen, B. Curless, and Z. Popović, "The Space of Human Body Shapes: Reconstruction and Parameterization from Range Scans," Proc. ACM Siggraph, pp. 587-594, 2003.
[2] D. Anguelov, P. Srinivasan, H.-C. Pang, and D. Koller, "The Correlated Correspondence Algorithm for Unsupervised Registration of Nonrigid Surfaces," Proc. Advances in Neural Information Processing Systems, pp. 33-40, 2004.
[3] Q. Anqi, D. Bitouk, and M.I. Miller, "Smooth Functional and Structural Maps on the Neocortex via Orthonormal Bases of the Laplace-Beltrami Operator," IEEE Trans. Medical Imaging, vol. 25, no. 10, pp. 1296-1306, Oct. 2006.
[4] M. Aubry, U. Schlickewei, and D. Cremers, "The Wave Kernel Signature: A Quantum Mechanical Approach to Shape Analysis," Proc. IEEE Int'l Conf. Computer Vision Workshops, pp. 1626-1633, 2011.
[5] M.A. Audette, F.P. Ferrie, and T.M. Peters, "An Algorithmic Overview of Surface Registration Techniques for Medical Imaging," Medical Image Analysis, vol. 4, no. 3, pp. 201-217, 2000.
[6] F. Bach and M.I. Jordan, "Learning Spectral Clustering," Proc. Advances in Neural Information Processing Systems, 2004.
[7] Y. Bengio, J.-F. Paiement, P. Vincent, O. Delalleau, N. Le Roux, and M. Ouimet, "Out-of-Sample Extensions for LLE, Isomap, MDS, Eigenmaps, and Spectral Clustering," Proc. Advances in Neural Information Processing Systems. 2004.
[8] P.J. Besl, "Geometric Modeling and Computer Vision," Proc. IEEE, vol. 76, no. 8, pp. 936-958, Aug. 1988.
[9] V. Blanz and T. Vetter, "A Morphable Model for the Synthesis of 3D Faces," Proc. ACM Siggraph, pp. 187-194, 1999.
[10] A.M. Bronstein, M.I. Bronstein, and R. Kimmel, "Generalized Multidimensional Scaling: A Framework for Isometry-Invariant Partial Surface Matching," Proc. Nat'l Academy of Science USA, vol. 103, no. 5, pp. 1168-1172, 2006.
[11] A.M. Bronstein, M.L. Bronstein, and R. Kimmel, "Calculus of Nonrigid Surfaces for Geometry and Texture Manipulation," IEEE Trans. Visualization and Computer Graphics, vol. 13, no. 5, pp. 902-913, Sept./Oct. 2007.
[12] A.M. Bronstein, M.M. Bronstein, U. Castellani, A. Dubrovina, L. Guibas, R. Horaud, R. Kimmel, D. Knossow, E. von Lavante, D. Mateus, M. Ovsjanikov, and A. Sharma, "SHREC: Robust Correspondence Benchmark," Proc. Eurographics Workshop 3DOR, 2010.
[13] A.M. Bronstein, M.M. Bronstein, and R. Kimmel, Numerical Geometry of Non-Rigid Shapes, first ed., Monographs in Computer Science. Springer, 2008.
[14] C. Cagniart, E. Boyer, and S. Ilic, "Probabilistic Deformable Surface Tracking from Multiple Videos," Proc. European Conf. Computer Vision, pp. 326-339, 2010.
[15] M. Carcassoni and E. Hancock, "Spectral Correspondence for Point Pattern Matching," Pattern Recognition, vol. 36, no. 1, pp. 193-204, 2003.
[16] U. Castellani, M. Cristani, and V. Murino, "Statistical 3D Shape Analysis by Local Generative Descriptors," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 33, no. 12, pp. 2555-2560, Dec. 2011.
[17] T. Chan, J. Gilbert, and S.-H. Teng, "Geometric Spectral Partitioning," Technical Report PARC CSL-94-15, Xerox, 1995.
[18] H. Chui, "A New Point Matching Algorithm for Non-Rigid Registration," Computer Vision and Image Understanding, vol. 89, pp. 114-141, 2003.
[19] F. Chung, Spectral Graph Theory. AMS, 1997.
[20] M. Desbrun, M. Meyer, P. Schröder, and A.H. Barr, "Implicit Fairing of Irregular Meshes Using Diffusion and Curvature Flow," Proc. ACM Siggraph, pp. 317-324, 1999.
[21] A. Dubrovina and R. Kimmel, "Matching Shapes by Eigendecomposition of the Laplace-Beltrami Operator," Proc. Int'l Symp. 3D Data Processing, Visualization and Transmission, 2010.
[22] A. Dubrovina and R. Kimmel, "Approximately Isometric Shape Correspondence by Matching Pointwise Spectral Features and Global Geodesic Structures," Advances in Adaptive Data Analysis, vol. 3, pp. 203-228, 2011.
[23] A. Elad and R. Kimmel, "On Bending Invariant Signatures for Surfaces," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 25, no. 10, pp. 1285-1295, Oct. 2003.
[24] B. Fischl and A.M. Dale, "Measuring the Thickness of the Human Cerebral Cortex from Magnetic Resonance Images," Proc. Nat'l Academy of Sciences USA, vol. 97, no. 20, pp. 11050-5, 2000.
[25] B. Fischl, M.I. Sereno, R.B. Tootell, and A.M. Dale, "High-Resolution Intersubject Averaging and a Coordinate System for the Cortical Surface," Human Brain Mapping, vol. 8, no. 4, pp. 272-284, 1999.
[26] B. Fischl, A. van der Kouwe, C. Destrieux, E. Halgren, F. Segonne, D.H. Salat, E. Busa, L.J. Seidman, J. Goldstein, D. Kennedy, V. Caviness, N. Makris, B. Rosen, and A.M. Dale, "Automatically Parcellating the Human Cerebral Cortex," Cerebral Cortex, vol. 14, no. 1, pp. 11-22, 2004.
[27] C. Fowlkes, S. Belongie, F. Chung, and J. Malik, "Spectral Grouping Using the Nystrom Method," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 26, no. 2, pp. 214-225, Feb. 2004.
[28] L. Grady and J.R. Polimeni, Discrete Calculus: Applied Analysis on Graphs for Computational Science. Springer, 2010.
[29] X. Gu, Y. Wang, T.F. Chan, P.M. Thompson, and S.-T. Yau, "Genus Zero Surface Conformal Mapping and Its Application to Brain Surface Mapping," IEEE Trans. Medical Imaging, vol. 23, no. 8, pp. 949-958, Aug. 2004.
[30] D. Hahnel, S. Thrun, and W. Burgard, "An Extension of the ICP Algorithm for Modeling Nonrigid Objects with Mobile Robots," Proc. Int'l Joint Conf. Artificial Intelligence, pp. 915-920, 2003.
[31] N. Halko, P.G. Martinsson, and J.A. Tropp, "Finding Structure with Randomness: Probabilistic Algorithms for Constructing Approximate Matrix Decompositions," SIAM, vol. 53, no. 2, pp. 217-288, 2011.
[32] O. Hinds, N. Rajendran, J.R. Polimeni, J.C. Augustinack, G. Wiggins, L.L. Wald, D.H. Rosas, A. Potthast, E.L. Schwartz, and B. Fischl, "Accurate Prediction of V1 Location from Cortical Folds in a Surface Coordinate System," Neuroimage, vol. 39, no. 4, pp. 1585-1599, 2008.
[33] V. Jain and H. Zhang, "Robust 3D Shape Correspondence in the Spectral Domain," Proc. IEEE Int'l Conf. Shape Modeling and Applications, p. 19, 2006.
[34] V.G. Kim, Y. Lipman, and T. Funkhouser, "Blended Intrinsic Maps," Proc. ACM Siggraph, 2011.
[35] M.H. Lin, "Tracking Articulated Objects in Real-Time Range Image Sequences," Proc. IEEE Int'l Conf. Computer Vision, vol. 1, pp. 648-653, 1999.
[36] Y. Lipman and T. Funkhouser, "Möbius Voting for Surface Correspondence," Proc. ACM Siggraph, 2009.
[37] R.F. Liu, H. Zhang, A. Shamir, and D. Cohen-Or, "A Part-Aware Surface Metric for Shape Analysis," Eurographics, vol. 28, no. 2, pp. 397-406, 2009.
[38] G. Lohmann, D.Y. von Cramon, and A.C. Colchester, "Deep Sulcal Landmarks Provide an Organizing Framework for Human Cortical Folding," Cerebral Cortex, vol. 18, no. 6, pp. 1415-1420, 2008.
[39] H. Lombaert, L. Grady, J.R. Polimeni, and F. Cheriet, "Spectral Correspondence for Brain Matching," Proc. 22nd Int'l Conf. Information Processing in Medical Imaging, vol. 22, pp. 660-673, 2011.
[40] D. Mateus, R. Horaud, D. Knossow, F. Cuzzolin, and E. Boyer, "Articulated Shape Matching Using Laplacian Eigenfunctions and Unsupervised Point Registration," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 1-8, 2008.
[41] A. Myronenko and X. Song, "Point-Set Registration: Coherent Point Drift," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 32, no. 12, pp. 2262-2275, Dec. 2010.
[42] M. Niethammer, M. Reuter, F.E. Wolter, S. Bouix, N. Peinecke, M.S. Koo, and M. Shenton, "Global Medical Shape Analysis Using the Laplace-Beltrami Spectrum," Proc. Int'l Conf. Medical Image Computing and Computer Assisted Intervention, vol. 4791, pp. 850-857, 2007.
[43] M. Ovsjanikov, Q. Mérigot, F. Mémoli, and L. Guibas, "One Point Isometric Matching with the Heat Kernel," Computer Graphics Forum, vol. 29, no. 5, pp. 1555-1564, 2010.
[44] M. Pelillo, K. Siddiqi, and S.W. Zucker, "Matching Hierarchical Structures Using Association Graphs," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 21, no. 11, pp. 1105-1120, Nov. 1999.
[45] M. Reuter, "Hierarchical Shape Segmentation and Registration via Topological Features of Laplace-Beltrami Eigenfunctions," Int'l J. Computer Vision, vol. 89, no. 2, pp. 287-308, 2009.
[46] M. Reuter, F.E. Wolter, M. Shenton, and M. Niethammer, "Laplace-Beltrami Eigenvalues and Topological Features of Eigenfunctions for Statistical Shape Analysis," Computer Aided Design, vol. 41, no. 10, pp. 739-755, 2009.
[47] S. Rusinkiewicz and M. Levoy, "Efficient Variants of the ICP Algorithm," Proc. Int'l Conf. 3D Digital Imaging and Modeling, pp. 145-152, 2001.
[48] J. Schreiner, A. Asirvatham, E. Praun, and H. Hoppe, "Inter-Surface Mapping," Proc. ACM Siggraph, pp. 870-877, 2004.
[49] E.L. Schwartz, A. Shaw, and E. Wolfson, "A Numerical Solution to the Generalized Mapmaker's Problem: Flattening Nonconvex Polyhedral Surfaces," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 11, no. 9, pp. 1005-1008, Sept. 1989.
[50] G.L. Scott and H.C. Longuet-Higgins, "An Algorithm for Associating the Features of Two Images," Proc. Royal Soc. Biological Sciences, vol. 244, no. 1309, pp. 21-26, 1991.
[51] L.S. Shapiro and J.M. Brady, "Feature-Based Correspondence: An Eigenvector Approach," Image and Vision Computing, vol. 10, no. 5, pp. 283-288, 1992.
[52] A. Sharma, R. Horaud, J. Cech, and E. Boyer, "Topologically-Robust 3D Shape Matching Based on Diffusion Geometry and Seed Growing," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 2481-2488, 2011.
[53] C.R. Shelton, "Morphable Surface Models," Int'l J. Computer Vision, vol. 38, no. 1, pp. 75-91, June 2000.
[54] J. Shi and J. Malik, "Normalized Cuts and Image Segmentation," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 22, no. 8, pp. 888-905, Aug. 2000.
[55] Y. Shi, I. Dinov, and A.W. Toga, "Cortical Shape Analysis in the Laplace-Beltrami Feature Space," Proc. Int'l Conf. Medical Image Computing and Computer Assisted Intervention, pp. 208-215, 2009.
[56] Y. Shi, B. Sun, R. Lai, I. Dinov, and A.W. Toga, "Automated Sulci Identification via Intrinsic Modeling of Cortical Anatomy," Proc. Int'l Conf. Medical Image Computing and Computer Assisted Intervention, pp. 49-56, 2010.
[57] A. Shokoufandeh, D. Macrini, S. Dickinson, K. Siddiqi, and S.W. Zucker, "Indexing Hierarchical Structures Using Graph Spectra," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 27, no. 7, pp. 1125-1140, July 2005.
[58] K. Siddiqi, A. Shokoufandeh, S.J. Dickinson, and S.W. Zucker, "Shock Graphs and Shape Matching," Int'l J. Computer Vision, vol. 35, no. 1, pp. 13-32, 1999.
[59] R. Sprengel, K. Rohr, and H.S. Stiehl, "Thin-Plate Spline Approximation for Image Registration," Proc. 18th Ann. IEEE Int'l Conf. Eng. in Medicine and Biology Soc., vol. 3, pp. 1190-1191, 1996.
[60] D.C. Steiner and J.M. Morvan, "Restricted Delaunay Triangulations and Normal Cycle," Proc. Symp. Computational Geometry, pp. 312-321, 2003.
[61] R.W. Sumner and J. Popović, "Deformation Transfer for Triangle Meshes," Proc. ACM Siggraph, pp. 399-405, 2004.
[62] J. Sun, M. Ovsjanikov, and L. Guibas, "A Concise and Provably Informative Multi-Scale Signature Based on Heat Diffusion," Proc. Symp. Geometry Processing, pp. 1383-1392, 2009.
[63] A. Tevs, M. Bokeloh, M. Wand, A. Schilling, and H.P. Seidel, "Isometric Registration of Ambiguous and Partial Data," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 1185-1192, 2009.
[64] T. Tung and T. Matsuyama, "Dynamic Surface Matching by Geodesic Mapping for 3D Animation Transfer," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 1402-1409, 2010.
[65] S. Umeyama, "An Eigendecomposition Approach to Weighted Graph Matching Problems," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 10, no. 5, pp. 695-703, Sept. 1988.
[66] O. van Kaick, H. Zhang, G. Hamarneh, and D. Cohen-Or, "A Survey on Shape Correspondence," Eurographics, vol. 30, no. 6, pp. 1681-1707, 2011.
[67] K. Varanasi, A. Zaharescu, E. Boyer, and R. Horaud, "Temporal Surface Tracking Using Mesh Evolution," Proc. European Conf. Computer Vision, pp. 30-43, 2008.
[68] S. Wuhrer, C. Shu, and P. Bose, "Posture Invariant Correspondence of Triangular Meshes in Shape Space," Proc. IEEE Int'l Conf. Computer Vision Workshops, pp. 1574-1581, 2009.
[69] B.T.T. Yeo, M.R. Sabuncu, T. Vercauteren, D.J. Holt, K. Amunts, K. Zilles, P. Golland, and B. Fischl, "Learning Task-Optimal Registration Cost Functions for Localizing Cytoarchitecture and Function in the Cerebral Cortex," IEEE Trans. Medical Imaging, vol. 29, no. 7, pp. 1424-41, July 2010.
[70] W. Zeng, R. Guo, F. Luo, and X. Gu, "Discrete Heat Kernel Determines Discrete Riemannian Metric," Graphical Models, vol. 74, no. 4, pp. 121-129, 2012.
[71] W. Zeng, D. Samaras, and D. Gu, "Ricci Flow for 3D Shape Analysis," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 32, no. 4, pp. 662-677, Apr. 2010.
[72] H. Zhang, A. Sheffer, D. Cohen Or, Q. Zhou, O. van Kaick, and A. Tagliasacchi, "Deformation-Driven Shape Correspondence," Proc. Symp. Geometry Processing, pp. 1431-1439, 2008.
[73] H. Zhang, O. Van Kaick, and R. Dyer, "Spectral Mesh Processing," Eurographics, vol. 29, no. 6, pp. 1865-1894, 2010.
[74] Y. Zheng and D. Doermann, "Robust Point Matching for Nonrigid Shapes by Preserving Local Neighborhood Structures," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 28, no. 4, pp. 643-649, Apr. 2006.
57 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool