This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Multisensor Image Registration via Implicit Similarity
May 2006 (vol. 28 no. 5)
pp. 794-801
This paper presents an approach to the registration of significantly dissimilar images, acquired by sensors of different modalities. A robust matching criterion is derived by aligning the locations of gradient maxima. The alignment is achieved by iteratively maximizing the magnitudes of the intensity gradients of a set of pixels in one of the images, where the set is initialized by the gradient maxima locations of the second image. No explicit similarity measure that uses the intensities of both images is used. The computation utilizes the full spatial information of the first image and the accuracy and robustness of the registration depend only on it. False matchings are detected and adaptively weighted using a directional similarity measure. By embedding the scheme in a "coarse to fine” formulation, we were able to estimate affine and projective global motions, even when the images were characterized by complex space varying intensity transformations. The scheme is especially suitable when one of the images is of considerably better quality than the other (noise, blur, etc.). We demonstrate these properties via experiments on real multisensor image sets.

[1] M. Irani and P. Anandan, “Robust Multisensor Image Alignment,” Proc. IEEE Int'l Conf. Computer Vision, pp. 959-966, Jan. 1998.
[2] H. Li, B.S. Manjunath, and S.K. Mitra, “A Contour-Based Approach to Multisensor Image Registration,” IEEE Trans. Image Processing, vol. 4, no. 3, pp. 320-334, Mar. 1995.
[3] W.M. Wells, P. Viola, H. Atsumi, and S. Nakajima, “Multimodal Volume Registration by Maximization of Mutual Information,” Medical Image Analysis, vol. 1, no. 1, pp. 35-51, 1996.
[4] J. Pluim, J. Maintz, and M. Viergever, “Image Registration by Maximization of Combined Mutual Information and Gradient Information,” IEEE Trans. Medical Imaging, vol. 19, no. 8, pp. 809-814, Aug. 2000.
[5] J.B.A. Maintz and M.A. Viergever, “A Survey of Medical Image Registration,” Medical Image Analysis, vol. 2, no. 1, pp. 1-36, 1998.
[6] R. Sharma and M. Pavel, “Registration of Video Sequences from Multiple Sensors,” Proc. Image Registration Workshop, pp. 361-366, 1997.
[7] A. Gueziec, X. Pennec, and N. Ayache, “Medical Image Registration Using Geometric Hashing,” IEEE Computational Science and Eng., vol. 4, no. 4, pp. 29-41, Oct.-Dec. 1997.
[8] M. Fischler and R. Bolles, “Random Sample Consensus: A Paradigm for Model Fitting with Applications to Image Analysis and Automated Cartography,” Comm. ACM, vol. 24, no. 6, pp. 381-395, 1981.
[9] A. Roche, G. Malandain, N. Ayache, and S. Prima, “Towards a Better Comprehension of Similarity Measures used in Medical Image Registration,” Proc. Second Int'l Conf. Medical Image Computing and Computer-Assisted Intervention (MICCAI '99), pp. 555-566, Sept. 1999.
[10] A. Roche, G. Malandain, X. Pennec, and N. Ayache, “The Correlation Ratio as a New Similarity Measure for Multimodal Image Registration,” Proc. First Int'l Conf. Medical Image Computing and Computer-Assisted Intervention (MICCAI), pp. 1115-1124, Oct. 1998.
[11] A. Collignon, F. Maes, D. Delaere, D. Vandermeulen, P. Suetens, and G. Marchal, Information Processing in Medical Imaging. pp. 263-274, Dordrecht: Kluwer Academic, 1995.
[12] Y. He, A. Ben-Hamza, and H. Krim, “A Generalized Divergence Measure for Robust Image Registration,” IEEE Trans. Signal Processing, vol. 51, no. 5, pp. 1211-1220, May 2003.
[13] L.G. Brown, “A Survey of Image Registration Techniques,” ACM Computing Surveys, vol. 24, no. 4, pp. 325-376, Dec. 1992.
[14] J. Pluim, J. Maintz, and M. Viergever, “Mutual Information Based Registration of Medical Images: A Survey,” IEEE Trans. Medical Imaging, vol. 22, no. 8, pp. 986-1004, Aug. 2003.
[15] P. Thevenaz and M. Unser, “Spline Pyramids for Inter-Modal Image Registration Using Mutual Information,” Proc. SPIE Conf. Mathematical Imaging: Wavelet Applications in Signal and Image Processing V, vol. 3169, pp. 236-247, July-Aug. 1997
[16] J. Pluim, J. Maintz, and M. Viergever, “Interpolation Artifacts in Mutual Information-Based Image Registration,” Computer Vision and Image Understanding, vol. 77, no. 2, pp. 211-232, Feb. 2000.
[17] Y. Keller and A. Averbuch, “Implicit Similarity: A New Approach to Multisensor Image Registration,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, vol. 2, pp. 543-548, June 2003.
[18] E.P. Simoncelli and E.H. Adelson, “Noise Removal via Bayesian Wavelet Coring,” Proc. IEEE Int'l Conf. Image Processing, pp. 379-382, Sept. 1996.
[19] J. Pluim, J. Maintz, and M. Viergever, “Image Registration by Maximization of Combined Mutual Information and Gradient Information,” IEEE Trans. Medical Imaging, vol. 19, no. 8, pp. 809-814, 2000.
[20] J. Zhang and A. Rangarajan, “A Unified Feature-Based Registration Method for Multimodality Images. ” Proc. IEEE Int'l Symp. Biomedical Imaging (ISBI), pp. 724-727, 2004.
[21] N. Tishby and N. Slonim, “Data Clustering by Markovian Relaxation and the Information Bottleneck Method,” Neural Information Processing Systems, pp. 640-646, 2000.
[22] C.G. Harris and M. Stephens, “A Combined Corner and Edge Detector,” Proc. Fourth Alvey Vision Conf., pp. 147-151, 1988.
[23] R. Kimmel and A.M. Bruckstein, “Regularized Laplacian Zero Crossings as Optimal Edge Integrators,” Int'l J. Computer Vision, vol. 53, no. 3, pp. 225-243, 2003.
[24] P. Gill, Practical Optimization. Academic Press, 1982.
[25] M. Irani and P. Anandan, “Vision Algorithms: Theory and Practice,” Proc. Int'l Workshop Vision Algorithms, Sept. 1999.
[26] F. Maes, A. Collignon, D. Vandermeulen, G. Marchal, and P. Suetens, “Multimodality Image Registration by Maximization of Mutual Information,” IEEE Trans. Medical Imaging, vol. 16, no. 2, pp. 187-198, 1997.
[27] J. Kybic and M. Unser, “Fast Parametric Elastic Image Registration,” IEEE Trans. Image Processing, vol. 12, no. 11, pp. 1427-1442, Nov. 2003.

Index Terms:
Global motion estimation, multisensor registration, multimodality image alignment.
Citation:
Yosi Keller, Amir Averbuch, "Multisensor Image Registration via Implicit Similarity," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 28, no. 5, pp. 794-801, May 2006, doi:10.1109/TPAMI.2006.100
Usage of this product signifies your acceptance of the Terms of Use.