The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.01 - January (2009 vol.31)
pp: 99-113
Maxime Taron , Éole Centrale de Paris and CERTIS, France
Nikos Paragios , Éole Centrale de Paris and INRIA, France
Marie-Pierre Jolly , Siemens Corporate Research, Princeton
ABSTRACT
Registration and modeling of shapes are two important problems in computer vision and pattern recognition. Despite enormous progress made over the past decade, these problems are still open. In this paper, we advance the state of the art in both directions. First we consider an efficient registration method that aims to recover a one-to-one correspondence between shapes and introduce measures of uncertainties driven from the data which explain the local support of the recovered transformations. To this end, a free form deformation is used to describe the deformation model. The transformation is combined with an objective function defined in the space of implicit functions used to represent shapes. Once the registration parameters have been recovered, we introduce a novel technique for model building and statistical interpretation of the training examples based on a variable bandwidth kernel approach. The support on the kernels varies spatially and is determined according to the uncertainties of the registration process. Such a technique introduces the ability to account for potential registration errors in the model. Hand-written character recognition and knowledge-based object extraction in medical images are examples of applications that demonstrate the potentials of the proposed framework.
INDEX TERMS
Surface fitting, Shape, Registration, Segmentation, Pattern matching, Nonparametric statistics, Vision and Scene Understanding, Artificial Intelligence, Computing Methodologies
CITATION
Maxime Taron, Nikos Paragios, Marie-Pierre Jolly, "Registration with Uncertainties and Statistical Modeling of Shapes with Variable Metric Kernels", IEEE Transactions on Pattern Analysis & Machine Intelligence, vol.31, no. 1, pp. 99-113, January 2009, doi:10.1109/TPAMI.2008.36
REFERENCES
[1] C. Goodall, “Procrustes Methods in the Statistical Analysis of Shape,” J. Royal Statistical Soc., vol. 53, no. 2, pp. 285-339, 1991.
[2] D. Rueckert, L. Sonoda, C. Hayes, D. Hill, M. Leach, and D. Hawkes, “Nonrigid Registration Using Free-Form Deformations: Application to Breast MR Images,” IEEE Trans. Medical Imaging, vol. 18, pp. 712-721, 1999.
[3] K. Arun, T. Huang, and S. Blostein, “Least-Squares Fitting of Two 3-D Point Sets,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 9, pp. 698-700, 1987.
[4] P. Besl and N. McKay, “A Method for Registration of 3-D Shapes,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 14, no. 2, pp. 239-256, Feb. 1992.
[5] J. Montagnat and H. Delingette, “A Hybrid Framework for Surface Registration and Deformable Models,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, 1997.
[6] C. Zahn and R. Roskies, “Fourier Descriptors for Plane Close Curves,” IEEE Trans. Computers, vol. 21, pp. 269-281, 1972.
[7] L. Staib and S. Duncan, “Boundary Finding with Parametrically Deformable Models,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 14, pp. 1061-1075, 1992.
[8] C. de Boor, A Practical Guide to Splines. Springer-Verlag, 1978.
[9] F. Leymarie and B. Kimia, “The Shock Scaffold for Representing 3-D Shape,” Proc. Int'l Workshop Visual Form, pp. 216-228, 2001.
[10] M. Leventon, E. Grimson, and O. Faugeras, “Statistical Shape Influence in Geodesic Active Contours,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, vol. 1, pp. 316-322, 2000.
[11] M. Lefébure and L. Cohen, “Image Registration, Optical Flow and Local Rigidity,” J. Math. Imaging Vision, vol. 14, no. 2, pp. 131-147, 2001.
[12] A. Trouvé, “Diffeomorphisms Groups and Pattern Matching in Image Analysis,” Int'l J. Computer Vision, vol. 28, no. 3, pp. 213-221, 1998.
[13] P. Lipson, A. Yuille, D. Okeefe, J. Cavanaugh, J. Taaffe, and D. Rosenthal, “Deformable Templates for Feature Extraction from Medical Images,” Proc. European Conf. Computer Vision, pp. 413-417, 1990.
[14] K. Rohr, M. Fornefett, and S. Stiehl, “Approximating Thin-Plate Splines for Elastic Registration: Integration of Landmark Errors and Orientation Attributes,” Information Processing in Medical Imaging, pp. 252-265, 1999.
[15] K. Pearson, “On Lines and Planes of Closest Fit to Systems of Points in Space,” Philosophical Magazine, vol. 2, no. 6, pp. 559-572, 1901.
[16] T. Cootes, C. Taylor, D. Cooper, and J. Graham, “Active Shape Models—Their Training and Application,” Computer Vision and Image Understanding, vol. 61, pp. 38-59, 1995.
[17] J. McQueen, “Some Methods for Classification and Analysis of Multivariate Observations,” Proc. Symp. Math. Statistics and Probability, vol. 1, pp. 281-297, 1967.
[18] E. Pauwels and G. Frederix, “Cluster-Based Segmentation of Natural Scenes,” Proc. Seventh IEEE Int'l Conf. Computer Vision, pp.997-1002, 1999.
[19] T. Cootes and C. Taylor, “Mixture Model for Representing Shape Variation,” Image and Vision Computing, vol. 17, pp. 567-574, 1999.
[20] H. Tenmoto, M. Kudo, and M. Shimbo, “MDL-Based Selection of the Number of Components in Mixture Models for Pattern Classification,” Advances in Pattern Recognition, vol. 1451, pp.831-836, 1998.
[21] A. Dempster, N. Laird, and D. Rubin, “Maximum Likelihood from Incomplete Data via the EM Algorithm,” J. Royal Statistical Soc., vol. 39, no. 1, pp. 1-38, 1977.
[22] C. Bishop, Neural Networks for Pattern Recognition. Oxford Univ. Press, 1996.
[23] A. Hyvärinen, J. Karhunen, and E. Oja, Independent Component Analysis. John Wiley & Sons, 2001.
[24] D. Cremers, T. Kohlberger, and C. Schnörr, “Shape Statistics in Kernel Space for Variational Image Segmentation,” Pattern Recognition, vol. 36, pp. 1929-1943, 2003.
[25] M. Üzümcü, A. Frangi, J. Reiber, and B. Lelieveldt, “Independent Component Analysis in Statistical Shape Models,” SPIE Medical Imaging, vol. 5032, pp. 375-383, 2003.
[26] M. Wand and M. Jones, Kernel Smoothing. Chapman & Hall, 1995.
[27] A. Rosenfeld and J. Pfaltz, “Distance Functions on Digital Pictures,” Pattern Recognition, vol. 1, pp. 33-61, 1968.
[28] N. Paragios, M. Rousson, and V. Ramesh, “Non-Rigid Registration Using Distance Functions,” Computer Vision and Image Understanding, vol. 89, no. 2-3, pp. 142-165, 2003.
[29] X. Huang, N. Paragios, and D. Metaxas, “Establishing Local Correspondences towards Compact Representations of Anatomical Structures,” Proc. Sixth Int'l Conf. Medical Image Computing and Computer-Assisted Intervention, 2003.
[30] X. Huang, N. Paragios, and D. Metaxas, “Shape Registration in Implicit Spaces Using Information Theory and Free Form Deformations,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 28, no. 8, pp. 1303-1318, Aug. 2006.
[31] X. Pennec and J.-P. Thirion, “A Framework for Uncertainty and Validation of 3-D Registration Methods Based on Points and Frames,” Int'l J. Computer Vision, vol. 25, no. 3, pp. 203-229, 1997.
[32] Z. Zhang, “Iterative Point Matching for Registration of Free-Form Curves and Surfaces,” Int'l J. Computer Vision, vol. 13, pp. 119-152, 1994.
[33] C. Stewart, C.-L. Tsai, and B. Roysam, “The Dual Bootstrap ICP Algorithm with Application to Retinal Image Registration,” IEEE Trans. Medical Imaging, vol. 22, pp. 1379-1394, 2003.
[34] C. Stewart, “Uncertainty-Driven Point-Based Image Registration,” Math. Models in Computer Vision: The Handbook, N. Paragios, Y.Chen, and O. Faugeras, eds., Springer, 2005.
[35] M. Sofka, G. Yang, and C.V. Stewart, “Simultaneous Covariance Driven Correspondence (CDC) and Transformation Estimation in the Expectation Maximization,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 18-23, June 2007.
[36] F. Bookstein, “Principal Warps: Thin-Plate Splines and the Decomposition of Deformations,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 11, no. 6, pp. 567-585, June 1989.
[37] M. Taron, N. Paragios, and M.-P. Jolly, “Modelling Shapes with Uncertainties: Higher Order Polynomials, Variable Bandwidth Kernels and Non Parametric Density Estimation,” Proc. 10th IEEE Int'l Conf. Computer Vision, pp. 1659-1666, 2005.
[38] M. Taron, N. Paragios, and M.-P. Jolly, “Uncertainty-Driven Non-Parametric Knowledge-Based Segmentation: The Corpus Callosum Case,” Proc. IEEE Workshop Variational and Level Set Methods, pp. 198-207, 2005.
[39] A. Tsai, W. Wells, S.K. Warfield, and A.S. Willsky, “Level Set Methods in an EM Framework for Shape Classification and Estimation,” Proc. Seventh Int'l Conf. Medical Image Computing and Computer-Assisted Intervention, pp. 1-9, 2004.
[40] A. Mittal and N. Paragios, “Motion-Based Background Subtraction Using Adaptive Kernel Density Estimation,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, vol. 2, pp. 302-309, 2004.
[41] G. Charpiat, O. Faugeras, and R. Keriven, “Approximations of Shape Metrics and Application to Shape Warping and Empirical Shape Statistics,” Foundations of Computational Math., vol. 5, no. 1, pp. 1-58, 2005.
[42] G. Borgefors, “Distance Transformations in Digital Images,” Computer Vision, Graphics, and Image Processing, vol. 34, pp. 344-371, 1986.
[43] Y. Wang, X. Huang, C.-H. Lee, S. Zhang, Z. Li, D. Samaras, D. Metaxas, A. Elgammal, and P. Huang, “High Resolution Acquisition, Learning and Transfer of Dynamic 3-D Facial Expressions,” Proc. Eurographics '04, pp. 677-686, 2004.
[44] T. Sederberg and S. Parry, “Free-Form Deformation of Solid Geometric Models,” Proc. ACM SIGGRAPH '86, vol. 20, pp. 151-160, 1986.
[45] Z. Xie and G. Farin, “Deformation with Hierarchical B-Splines,” Math. Methods for Curves and Surfaces, pp. 545-554, Vanderbilt Univ., 2001.
[46] K. Kanatani, “Uncertainty Modeling and Model Selection for Geometric Inference,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 26, no. 10, pp. 1307-1319, Oct. 2004.
[47] E. Simoncelli, “Bayesian Multi-Scale Differential Optical Flow,” Handbook of Computer Vision and Applications, B. Jähne, H.Haussecker, and P. Geissler, eds., chapter 14, vol. 2, pp. 397-422, Academic Press, 1999.
[48] Y. Chen and G. Medioni, “Object Modeling by Registration of Multiple Range Images,” Image and Vision Computing, vol. 10, pp.145-155, 1992.
[49] S.R. Sain, “Multivariate Locally Adaptive Density Estimation,” Computational Statistics and Data Analysis, vol. 39, no. 2, pp. 165-186, 2002.
[50] D. DeMenthon and R. Megret, “The Variable Bandwidth Mean Shift and Data-Driven Scale Selection,” Proc. Eighth IEEE Int'l Conf. Computer Vision, pp. 438-445, 2001.
[51] H. Chen and P. Meer, “Robust Computer Vision through Kernel Density Estimation,” Proc. European Conf. Computer Vision, pp. 236-250, 2002.
[52] D. Comaniciu and P. Meer, “Mean Shift: A Robust Approach toward Feature Space Analysis,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 24, no. 5, pp. 603-619, May 2002.
[53] Y. LeCun, “The MNIST Database of Handwritten Digits,” http://yann.lecun.com/exdbmnist/, 2008.
[54] J. Ma, Y. Zhao, and S. Ahalt, “OSU SVM Classifier Matlab Toolbox,” http://www.ece.osu.edu/~majosu_svm/, 2008.
[55] D. Mumford and J. Shah, “Optimal Approximations by Piecewise Smooth Functions and Associated Variational Problems,” Comm. Pure and Applied Math., vol. 42, pp. 577-685, 1989.
[56] A. Lundervold, N. Duta, T. Taxt, and A. Jain, “Model-Guided Segmentation of Corpus Callosum in MR Images,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 1231-1238, 1999.
[57] B. Schölkopf and A.J. Smola, Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond. The MIT Press, 2001.
31 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool