CSDL Home IEEE Transactions on Pattern Analysis & Machine Intelligence 2012 vol.34 Issue No.05 - May

Subscribe

Issue No.05 - May (2012 vol.34)

pp: 943-958

Csaba Domokos , University of Szeged, Szeged

Jozsef Nemeth , University of Szeged, Szeged

Zoltan Kato , University of Szeged, Szeged

ABSTRACT

In this paper, we propose a novel framework to estimate the parameters of a diffeomorphism that aligns a known shape and its distorted observation. Classical registration methods first establish correspondences between the shapes and then compute the transformation parameters from these landmarks. Herein, we trace back the problem to the solution of a system of nonlinear equations which directly gives the parameters of the aligning transformation. The proposed method provides a generic framework to recover any diffeomorphic deformation without established correspondences. It is easy to implement, not sensitive to the strength of the deformation, and robust against segmentation errors. The method has been applied to several commonly used transformation models. The performance of the proposed framework has been demonstrated on large synthetic data sets as well as in the context of various applications.

INDEX TERMS

Image registration, diffeomorphism, nonlinear transformation, planar homography, thin plate spline, shape matching.

CITATION

Csaba Domokos, Jozsef Nemeth, Zoltan Kato, "Nonlinear Shape Registration without Correspondences",

*IEEE Transactions on Pattern Analysis & Machine Intelligence*, vol.34, no. 5, pp. 943-958, May 2012, doi:10.1109/TPAMI.2011.200REFERENCES

- [1] L. Zagorchev and A. Goshtasby, "A Comparative Study of Transformation Functions for Nonrigid Image Registration,"
IEEE Trans. Image Processing, vol. 15, no. 3, pp. 529-538, Mar. 2006.- [2] J.A. Ventura and W. Wan, "Accurate Matching of Two-Dimensional Shapes Using the Minimal Tolerance Zone Error,"
Image and Vision Computing, vol. 15, pp. 889-899, Dec. 1997.- [3] S. Belongie, J. Malik, and J. Puzicha, "Shape Matching and Object Recognition Using Shape Context,"
IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 24, no. 4, pp. 509-522, Apr. 2002.- [4] D.L.G. Hill, P.G. Batchelor, M. Holden, and D.J. Hawkes, "Medical Image Registration,"
Physics in Medicine and Biology, vol. 46, pp. R1-R45, Mar. 2001.- [5] B. Zitová and J. Flusser, "Image Registration Methods: A Survey,"
Image and Vision Computing, vol. 21, pp. 977-1000, Oct. 2003.- [6] J.B.A. Maintz and M.A. Viergever, "A Survey of Medical Image Registration,"
Medical Image Analysis, vol. 2, pp. 1-36, Mar. 1998.- [7] H. Guo, A. Rangarajan, S. Joshi, and L. Younes, "Non-Rigid Registration of Shapes via Diffeomorphic Point Matching,"
Proc. IEEE Int'l Symp. Biomedical Imaging: From Nano to Macro, pp. 924-927, Apr. 2004.- [8] S. Mann and R.W. Picard, "Video Orbits of the Projective Group a Simple Approach to Featureless Estimation of Parameters,"
IEEE Trans. Image Processing, vol. 6, no. 9, pp. 1281-1295, Sept. 1997.- [9] M.S. Hansen, M.F. Hansen, and R. Larsen, "Diffeomorphic Statistical Deformation Models,"
Proc. IEEE Int'l Conf. Computer Vision, pp. 1-8, Oct. 2007.- [10] D.G. Lowe, "Distinctive Image Features from Scale-Invariant Keypoints,"
Int'l J. Computer Vision, vol. 60, pp. 91-110, Nov. 2004.- [11] S. Kaneko, Y. Satohb, and S. Igarashi, "Using Selective Correlation Coefficient for Robust Image Registration,"
Pattern Recognition, vol. 36, pp. 1165-1173, May 2003.- [12] K.M. Simonson, S.M. Drescher, and F.R. Tanner, "A Statistics-Based Approach to Binary Image Registration with Uncertainty Analysis,"
IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 29, no. 1, pp. 112-125, Jan. 2007.- [13] J. Nemeth, C. Domokos, and Z. Kato, "Recovering Planar Homographies between 2D Shapes,"
Proc. IEEE Int'l Conf. Computer Vision, pp. 2170-2176, Sept. 2009.- [14] J. Nemeth, C. Domokos, and Z. Kato, "Nonlinear Registration of Binary Shapes,"
Proc. IEEE Int'l Conf. Image Processing, pp. 1001-1004, Nov. 2009.- [15] D.W. Marquardt, "An Algorithm for Least-Squares Estimation of Nonlinear Parameters,"
SIAM J. Applied Math., vol. 11, no. 2, pp. 431-441, 1963.- [16] J.M. Francos, R. Hagege, and B. Friedlander, "Estimation of Multidimensional Homeomorphisms for Object Recognition in Noisy Environments,"
Proc. Conf. Signals, Systems and Computers, vol. 2, pp. 1615-1619, Nov. 2003.- [17] V. Lepetit and P. Fua, "Keypoint Recognition Using Randomized Trees,"
IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 28, no. 9, pp. 1465-1479, Sept. 2006.- [18] M.P. Kumar, S. Kuthirummal, C.V. Jawahar, and P.J. Narayanan, "Planar Homography from Fourier Domain Representation,"
Proc. IEEE Int'l Conf. Signal Processing and Comm., pp. 560-564, Dec. 2004.- [19] M. Nielsen, P. Johansen, A.D. Jackson, B. Lautrup, and S. Hauberg, "Brownian Warps for Non-Rigid Registration,"
J. Math. Imaging and Vision, vol. 31, pp. 221-231, July 2008.- [20] A. Shekhovtsov, I. Kovtun, and V. Hlaváč, "Efficient MRF Deformation Model for Non-Rigid Image Matching,"
Computer Vision and Image Understanding, vol. 112, pp. 91-99, Oct. 2008.- [21] S. Klein, J.P. Pluim, M. Staring, and M.A. Viergever, "Adaptive Stochastic Gradient Descent Optimisation for Image Registration,"
Int'l J. Computer Vision, vol. 81, pp. 227-239, Mar. 2009.- [22] S. Marsland and C. Twining, "Constructing Diffeomorphic Representations for the Groupwise Analysis of Nonrigid Registrations of Medical Images,"
IEEE Trans. Medical Imaging, vol. 23, no. 8, pp. 1006-1020, Aug. 2004.- [23] V. Arsigny, O. Commowick, N. Ayache, and X. Pennec, "A Fast and Log-Euclidean Polyaffine Framework for Locally Linear Registration,"
J. Math. Imaging and Vision, vol. 33, pp. 222-238, Feb. 2009.- [24] C. Domokos and Z. Kato, "Parametric Estimation of Affine Deformations of Planar Shapes,"
Pattern Recognition, vol. 43, pp. 569-578, Mar. 2010.- [25] T. Suk and J. Flusser, "Affine Normalization of Symmetric Objects,"
Proc. Int'l Conf. Advanced Concepts for Intelligent Vision Systems, pp. 100-107, Sept. 2005.- [26] P. Jain and C.V. Jawahar, "Homography Estimation from Planar Contours,"
Proc. Int'l Symp. 3D Data Processing, Visualization, and Transmission, pp. 877-884, June 2006.- [27] J. Wang and Y. Liu, "Characteristic Line of Planar Homography Matrix and Its Applications in Camera Calibration,"
Proc. IEEE Int'l Conf. Pattern Recognition, pp. 147-150, Aug. 2006.- [28] A.M. Bronstein, M.M. Bronstein, A.M. Bruckstein, and R. Kimmel, "Analysis of Two-Dimensional Non-Rigid Shapes,"
Int'l J. Computer Vision, vol. 78, pp. 67-88, June 2008.- [29] H.D. Tagare, D. Groisser, and O. Skrinjar, "Symmetric Non-Rigid Registration: A Geometric Theory and Some Numerical Techniques,"
J. Math. Imaging and Vision, vol. 34, pp. 61-88, May 2009.- [30] A. Yezzi, L. Zöllei, and T. Kapurz, "A Variational Framework for Joint Segmentation and Registration,"
Proc. IEEE Workshop Math. Methods in Biomedical Image Analysis, pp. 44-51, Dec. 2001.- [31] K.M. Simonson, S.M. Drescher, and F.R. Tanner, "A Statistics-Based Approach to Binary Image Registration with Uncertainty Analysis,"
IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 29, no. 1, pp. 112-125, Jan. 2007.- [32] S. Wörz and K. Rohr, "Physics-Based Elastic Registration Using Non-Radial Basis Functions and Including Landmark Localization Uncertainties,"
Computer Vision Image Understanding, vol. 111, no. 3, pp. 263-274, 2008.- [33] H. Bay, A. Ess, T. Tuytelaars, and L. Van Gool, "Speeded-Up Robust Features (SURF),"
Computer Vision and Image Understanding, vol. 110, pp. 346-359, Aug. 2008.- [34] Z. Tu, S. Zheng, and A. Yuille, "Shape Matching and Registration by Data-Driven EM,"
Computer Vision and Image Understanding, vol. 109, pp. 290-304, Mar. 2008.- [35] J. Flusser, T. Suk, and B. Zitová,
Moments and Moment Invariants in Pattern Recognition. Wiley and Sons, Oct. 2009.- [36] M.-K. Hu, "Visual Pattern Recognition by Moment Invariants,"
IRE Trans. Information Theory, vol. 8, pp. 179-187, Feb. 1962.- [37] A. Foulonneau, P. Charbonnier, and F. Heitz, "Multi-Reference Shape Priors for Active Contours,"
Int'l J. Computer Vision, vol. 81, pp. 68-81, Jan. 2009.- [38] M.R. Teague, "Image Analysis via the General Theory of Moments,"
J. Optical Soc. Am., vol. 70, pp. 920-930, Aug. 1980.- [39] L. van Gool, T. Moons, E. Pauwels, and A. Oosterlinck, "Vision and Lie's Approach to Invariance,"
Image and Vision Computing, vol. 13, pp. 259-277, May 1995.- [40] J. Flusser and T. Suk, "Projective Moment Invariants,"
IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 26, no. 10, pp. 1364-1367, Oct. 2004.- [41] J. Flusser and T. Suk, "Pattern Recognition by Affine Moment Invariants,"
Pattern Recognition, vol. 1, pp. 167-174, Jan. 1993.- [42] J. Flusser, J. Kautsky, and F. Šroubek, "Implicit Moment Invariants,"
Int'l J. Computer Vision, vol. 86, pp. 72-86, Jan. 2010.- [43] A. Goshtasby, "Registration of Images with Geometric Distortions,"
IEEE Trans. Geoscience and Remote Sensing, vol. 26, no. 1, pp. 60-64, Jan. 1988.- [44] F.L. Bookstein, "Principal Warps: Thin-Plate Splines and the Decomposition of Deformations,"
IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 11, no. 6, pp. 567-585, June 1989.- [45] R. Merris,
Combinatorics, second, ed. John Wiley and Sons, Aug. 2003.- [46] M. Lourakis, "Homest: A C/C++ Library for Robust, Non-Linear Homography Estimation," software, http://www.ics.forth.gr/ ~lourakishomest /, 2008.
- [47] C.F. Paulo and P.L. Correia, "Automatic Detection and Classification of Traffic Signs,"
Proc. IEEE Workshop Image Analysis for Multimedia Interactive Services, pp. 11-14, June 2007.- [48] M. Downing, P. Undrill, P. Ashcroft, D. Hukins, and J. Hutchison, "Automated Femoral Measurement in Total Hip Replacement Radiographs,"
Proc. IEEE Int'l Conf. Image Processing and Its Applications, pp. 843-847, July 1997.- [49] C. Florea, C. Vertan, and L. Florea, "Logarithmic Model-Based Dynamic Range Enhancement of Hip X-Ray Images,"
Proc. Int'l Conf. Advanced Concepts for Intelligent Vision Systems, pp. 587-596, Aug. 2007.- [50] A. Oprea and C. Vertan, "A Quantitative Evaluation of the Hip Prosthesis Segmentation Quality in X-Ray Images,"
Proc. IEEE Int'l Symp. Signals, Circuits, and Systems, pp. 1-4, July 2007.- [51] T. Boudier, "The Snake Plugin for ImageJ," software, http://www.snv.jussieu.fr/~wboudier/softs snake.html, 2011.
- [52] Z. Zhang, R. Deriche, O.D. Faugeras, and Q.T. Luong, "A Robust Technique for Matching Two Uncalibrated Images through the Recovery of the Unknown Epipolar Geometry,"
Artificial Intelligence, vol. 78, pp. 87-119, Oct. 1995.- [53] R. Hartley, "In Defense of the Eight-Point Algorithm,"
IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 19, no. 6, pp. 580-593, June 1997.- [54] Y. LeCun and C. Cortes, "The MNIST Database of Handwritten Digits," database, http://yann.lecun.com/exdbmnist/, 2011.
- [55] S. Ghose, A. Oliver, R. Marti, X. Llado, J. Freixenet, J.C. Vilanova, and F. Meriaudeau, "Prostate Segmentation with Texture Enhanced Active Appearance Model,"
Proc. IEEE Int'l Conf. Signal-Image Technology and Internet Based Systems, pp. 18-22, Dec. 2010.- [56] J. Mitra, A.O.R. Marti, X. Llado, J.C. Vilanova, and F. Meriaudeau, "A Thin-Plate Spline Based Multimodal Prostate Registration with Optimal Correspondences,"
Proc. IEEE Int'l Conf. Signal-Image Technology and Internet Based Systems, pp. 7-11, Dec. 2010. |