The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.12 - December (2008 vol.30)
pp: 2098-2108
ABSTRACT
Image registration consists in estimating geometric and photometric transformations that align two images as best as possible. The direct approach consists in minimizing the discrepancy in the intensity or color of the pixels. The inverse compositional algorithm has been recently proposed by Baker et al. for the direct estimation of groupwise geometric transformations. It is efficient in that it performs several computationally expensive calculations at a pre-computation phase. Photometric transformations act on the value of the pixels. They account for effects such as lighting change. Jointly estimating geometric and photometric transformations is thus important for many tasks such as image mosaicing. We propose an algorithm to jointly estimate groupwise geometric and photometric transformations while preserving the efficient pre-computation based design of the original inverse compositional algorithm. It is called the dual inverse compositional algorithm. It uses different approximations than the simultaneous inverse compositional algorithm and handles groupwise geometric and global photometric transformations. Its name stems from the fact that it uses an inverse compositional update rule for both the geometric and the photometric transformations. We demonstrate the proposed algorithm and compare it to previous ones on simulated and real data. This shows clear improvements in computational efficiency and in terms of convergence.
INDEX TERMS
Computer vision, Intensity, color, photometry, and thresholding
CITATION
Adrien Bartoli, "Groupwise Geometric and Photometric Direct Image Registration", IEEE Transactions on Pattern Analysis & Machine Intelligence, vol.30, no. 12, pp. 2098-2108, December 2008, doi:10.1109/TPAMI.2008.22
REFERENCES
[1] S. Baker, R. Gross, and I. Matthews, “Lucas-Kanade 20 Years On: A Unifying Framework: Part 3,” Technical Report CMU-RI-TR-03-35, Robotics Inst., Carnegie Mellon Univ., Nov. 2003.
[2] S. Baker and I. Matthews, “Lucas-Kanade 20 Years On: A Unifying Framework,” Int'l J. Computer Vision, vol. 56, no. 3, pp. 221-255, Feb. 2004.
[3] A. Bartoli, “Groupwise Geometric and Photometric Direct Image Registration,” Proc. British Machine Vision Conf., 2006.
[4] G.D. Finlayson, M.S. Drew, and B. Funt, “Color Constancy: Generalized Diagonal Transforms Suffice,” J. Optical Soc. of Am. A, vol. 11, no. 11, pp. 3011-3019, Nov. 1994.
[5] M. Gouiffes, C. Collewet, C. Fernandez-Maloigne, and A. Trémeau, “Feature Point Tracking: Robustness to Specular Highlights and Lighting Changes,” Proc. European Conf. Computer Vision, 2006.
[6] R.C. Hardie, K.J. Barnard, and E.E. Armstrong, “Joint MAP Registration and High-Resolution Image Estimation Using a Sequence of Undersampled Images,” IEEE Trans. Image Processing, vol. 6, no. 12, pp. 1621-1633, Dec. 1997.
[7] B. Heigl, D. Paulus, and H. Niemann, “Tracking Points in Sequences of Color Images,” Pattern Recognition and Image Understanding, 1999.
[8] M. Irani and P. Anandan, “About Direct Methods,” Proc. Workshop Vision Algorithms: Theory and Practice, 1999.
[9] H. Jin, P. Favaro, and S. Soatto, “Real-Time Feature Tracking and Outlier Rejection with Changes in Illumination,” Proc. Int'l Conf. Computer Vision, 2001.
[10] S.-H. Lai and M. Fang, “Robust and Efficient Image Alignment with Spatially Varying Illumination Models,” Proc. Int'l Conf. Computer Vision and Pattern Recognition, 1999.
[11] T. Tommasini, A. Fusiello, E. Trucco, and V. Roberto, “Improving Feature Tracking with Robust Statistics,” Pattern Analysis and Applications, vol. 2, no. 4, pp. 312-320, 1999.
[12] P.H.S. Torr and A. Zisserman, “Feature Based Methods for Structure and Motion Estimation,” Proc. Workshop Vision Algorithms: Theory and Practice, 1999.
[13] B.C. Vemuri, S. Huang, S. Sahni, C.M. Leonard, C. Mohr, R. Gilmore, and J. Fitzsimmons, “An Efficient Motion Estimator with Application to Medical Image Registration,” Medical Image Analysis, vol. 2, no. 1, pp. 79-98, 1998.
15 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool