This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Unconstrained Automatic Image Matching Using Multiresolutional Critical-Point Filters
September 1998 (vol. 20 no. 9)
pp. 994-1010

Abstract—This paper proposes a novel method for matching images. The results can be used for a variety of applications: fully automatic morphing, object recognition, stereo photogrammetry, and volume rendering. Optimal mappings between the given images are computed automatically using multiresolutional nonlinear filters that extract the critical points of the images of each resolution. Parameters are set completely automatically by dynamical computation analogous to human visual systems. No prior knowledge about the objects is necessary. The matching results can be used to generate intermediate views when given two different views of objects. When used for morphing, our method automatically transforms the given images. There is no need for manually specifying the correspondence between the two images. When used for volume rendering, our method reconstructs the intermediate images between cross-sections accurately, even when the distance between them is long and the cross-sections vary widely in shape. A large number of experiments has been carried out to show the usefulness and capability of our method.

[1] R. Bajcsy and S. Kovacic, "Multiresolution Elastic Matching," Computer Vision, Graphics, and Image Processing, vol. 46, pp. 1-21, 1989.
[2] J.A. Bangham, P. Ling, and R. Harvey, “Scale-Space from Nonlinear Filters,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 18, no. 5, pp. 520-528, May 1996.
[3] G. Barequet and M. Sharir, “Partial Surface and Volume Matching in Three Dimensions,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 19, no. 9, pp. 929-948, Sept. 1997.
[4] T. Beier and S. Neely, "Feature-Based Image Metamorphosis," Computer Graphics (Proc. ACM SIGGRAPH'92), vol. 26, no. 2, pp. 35-42, July 1992.
[5] G. Borgefors, "Hierarchical Chamfer Matching: A Parametric Edge Matching Algorithm," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 10, pp. 849-865, 1988.
[6] G. Brookshire, M. Nadler, and C. Lee, "Automated Stereophotogrammetry," Computer Vision, Graphics, and Image Processing, vol. 52, pp. 276-296, 1990.
[7] D.J. Burr, "A Dynamic Model for Image Registration," Computer Vision, Graphics, and Image Processing, vol. 15, pp. 102-112, 1981.
[8] J. Canny, "A Computational Approach to Edge Detection," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 8, no. 6, pp. 679-698, 1986.
[9] C.K. Chui, An Introduction to Wavelets.Orlando, Fla.: Academic Press, 1992.
[10] I. Daubechies, Ten Lectures on Wavelets.Philadelphia, Penn.: Soc. Industrial and Applied Mathematics, 1992.
[11] O. Faugeras and L. Robert, "What Can Two Images Tell Us About a Third One," Int'l J. Computer Vision, vol. 18, pp. 5-19, 1996.
[12] D. Geiger, B. Ladendorf, and A. Yuille, "Occlusions and Binocular Stereo," Int'l J. Computer Vision, vol. 14, pp. 211-226, 1995.
[13] W.E.L. Grimson, "An Implementation of a Computational Theory of Visual Surface Interpolation," Computer Vision, Graphics, and Image Processing, vol. 22, pp. 39-69, 1983.
[14] N.C. Gupta and L.N. Kanal, "3-D Motion Estimation From Motion Field," Artificial Intelligence, vol. 78, pp. 45-86, 1995.
[15] M. Herman and T. Kanade, "Incremental Reconstruction of 3D Scenes From Multiple, Complex Images," Artificial Intelligence, vol. 30, pp. 289-341, 1986.
[16] M. Herman, T. Kanade, and S. Kuroe, "Incremental Acquistion of a Three-Dimensional Scene Model From Images," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 6, no. 3, pp. 331-340, 1984.
[17] W. Hoff and N. Ahuja, "Surfaces From Stereo: Integrating Feature Matching, Disparity Estimation, and Contour Detection," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 11, no. 2, pp. 121-136, Feb. 1989.
[18] B.K.P. Horn, Robot Vision.Cambridge, Mass., The MIT Press, 1986.
[19] M. Levoy, “Display of Surfaces from Volume Data,” IEEE Computer Graphics and Applications, vol. 8, no. 3, pp. 29-37, 1988.
[20] W.E. Lorensen and H.E. Cline, "Marching Cubes: A High Resolution 3D Surface Construction Algorithm," Computer Graphics (Proc. ACM SIGGRAPH'87), vol. 21, no. 4, pp. 163-169, Aug. 1987.
[21] S.G. Mallat,“A theory for multiresolution signal decomposition: The wavelet representation,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 11, no. 7, pp. 674-693, 1989.
[22] Y. Meyer, Wavelets: Algorithms and Applications.Philadelphia, Penn.: Soc. Industrial and Applied Mathematics, 1993.
[23] T. Nishita, T. Fujita, and E. Nakamae, "Metamorphosis Using Bézier Clipping," T.S. Chua and T.L. Kunii, eds., Mulitimedia Modeling (Proc. First Int'l Conf. Multimedia Modeling), pp. 162-175.Singapore: World Scientific, 1993.
[24] M. Otte and H.-H. Nagel, "Estimation of Optical Flow Based on Higher-Order Spationtemporal Derivatives in Interlaced and Noninterlaced Image Sequences," Artificial Intelligence, vol. 78, pp. 5-43, 1995.
[25] S.M. Seitz and C.R. Dyer, "View Morphing," Proc. ACM SIGGRAPH'96, pp. 21-30, 1996.
[26] D. Terzopoulos, "The Computation of Visible Surface Representations," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 10, no. 4, pp. 417-438, Apr. 1988.
[27] S. Ullman and R. Basri, "Recognition by Linear Combinations of Models," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 13, pp. 992-1006, 1991.
[28] V. Venkateswar and R. Chellappa, "Occlusions and Binocular Stereo," Int'l J. Computer Vision, vol. 15, pp. 245-269, 1995.
[29] J. Weber and J. Malik, "Robust Computation of Optical Flow in a Multi-Scale Differential Framework. Int'l J. Computer Vision, vol. 14, pp. 67-81, 1995.
[30] G. Wolberg, Digital Image Warping.Los Alamitos, Calif.: IEEE CS Press, 1990.
[31] Y. Yang and A.L. Yuille, "Multilevel Enhancement and Detection of Stereo Disparity Surfaces," Artificial Intelligence, vol. 78, pp. 121-145, 1995.
[32] Z. Zhang, R. Deriche, O. Faugeras, and Q-T. Luong, "A Robust Technique for Matching Two Uncalibrated Images Through the Recovery of the Unknown Epipolar Geometry," Artificial Intelligence, vol. 78, pp. 87-119, 1995.

Index Terms:
Image matching, multiresolution, nonlinear filters, critical-point filters, singularity, homotopy, image interpolation, morphing, volume rendering.
Citation:
Yoshihisa Shinagawa, Tosiyasu L. Kunii, "Unconstrained Automatic Image Matching Using Multiresolutional Critical-Point Filters," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 20, no. 9, pp. 994-1010, Sept. 1998, doi:10.1109/34.713364
Usage of this product signifies your acceptance of the Terms of Use.