This Article 
 Bibliographic References 
 Add to: 
Rotation Recovery from Spherical Images without Correspondences
July 2006 (vol. 28 no. 7)
pp. 1170-1175
This paper addresses the problem of rotation estimation directly from images defined on the sphere and without correspondence. The method is particularly useful for the alignment of large rotations and has potential impact on 3D shape alignment. The foundation of the method lies in the fact that the spherical harmonic coefficients undergo a unitary mapping when the original image is rotated. The correlation between two images is a function of rotations and we show that it has an SO(3)-Fourier transform equal to the pointwise product of spherical harmonic coefficients of the original images. The resolution of the rotation space depends on the bandwidth we choose for the harmonic expansion and the rotation estimate is found through a direct search in this 3D discretized space. A refinement of the rotation estimate can be obtained from the conservation of harmonic coefficients in the rotational shift theorem. A novel decoupling of the shift theorem with respect to the Euler angles is presented and exploited in an iterative scheme to refine the initial rotation estimates. Experiments show the suitability of the method for large rotations and the dependence of the method on bandwidth and the choice of the spherical harmonic coefficients.

[1] G.B. Arfken and H.J. Weber, Mathematical Methods for Physicists. Academic Press, 1966.
[2] J.R. Bergen, P. Anandan, K.J. Hanna, and R. Hingorani, “Hierarchical Model-Based Motion Estimation,” Proc. Second European Conf. Computer Vision, G. Sandini, ed., pp. 237-252, May 1992.
[3] G. Burel and H. Henocq, “Determination of the Orientation of 3D Objects Using Spherical Harmonics,” Graphical Models and Image Processing, vol. 57, pp. 400-408, 1995.
[4] G.S. Chirikjian and A.B. Kyatkin, Engineering Applications of Noncommutative Harmonic Analysis: With Emphasis on Rotation and Motion Groups. CRC Press, 2000.
[5] J.R. Driscoll and D.M. Healy, “Computing Fourier Transforms and Convolutions on the 2-Sphere,” Advances in Applied Math., vol. 15, pp. 202-250, 1994.
[6] C. Fermuller and J. Aloimonos, “Perception of Three-Dimensional Motion from Patterns of Visual Motion,” Science, vol. 270, pp. 1973-1976, 1995.
[7] T. Funkhouser, M. Kazhdan, P. Shilane, P. Min, W. Kiefer, A. Tal, S. Rusinkiewicz, and D. Dobkin, “Modeling by Example,” Proc. ACM SIGGRAPH, pp. 652-663, 2004.
[8] C. Geyer and K. Daniilidis, “Catadioptric Projective Geometry,” Int'l J. Computer Vision, vol. 43, pp. 223-243, 2001.
[9] B.K.P. Horn, “Extended Gaussian Images,” Proc. IEEE, vol. 72, pp. 1671-1686, 1984.
[10] S.B. Kang and K. Ikeuchi, “The Complex EGI: A New Representation for 3D Pose Determination,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 15, no. 7, pp. 707-721, July 1993.
[11] M. Kazhdan, T. Funkhouser, and S. Rusinkiewicz, “Rotation Invariant Spherical Harmonic Representation of 3D Shape Descriptors,” Proc. Symp. Geometry Processing, June 2003.
[12] M. Kazhdan, T. Funkhouser, and S. Rusinkiewicz, “Symmetry Descriptors and 3D Shape Matching,” Proc. Symp. Geometry Processing, July 2004.
[13] P.J. Kostelec and D.N. Rockmore, “FFTs on the Rotation Group,” Working Paper Series, Santa Fe Inst., 2003.
[14] J.A. Kovacs and W. Wriggers, “Fast Rotational Matching,” Biological Crystallography, vol. 58, pp. 1282-1286, 2002.
[15] R. Lenz, “Rotation-Invariant Operators,” Proc. Int'l Conf. Pattern Recognition, pp. 1130-1132, Sept. 1986.
[16] A. Leonardis and M. Jogan, “Robust Localization Using Eigenspace of Spinning-Images,” Proc. IEEE Workshop Omnidirectional Vision, pp. 37-46, June 2000.
[17] A. Makadia and K. Daniilidis, “Direct 3D-Rotation Estimation from Spherical Images via a Generalized Shift Theorem,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, June 2003.
[18] A. Makadia, C. Geyer, S. Sastry, and K. Daniilidis, “Radon-Based Structure from Motion without Correspondences,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, June 2005.
[19] A. Makadia, L. Sorgi, and K. Daniilidis, “Rotation Estimation from Spherical Images,” Proc. Int'l Conf. Pattern Recognition, 2004.
[20] S. Nayar, “Catadioptric Omnidirectional Camera,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 482-488, June 1997.
[21] S. Negahdaripour and B.K.P. Horn, “Direct Passive Navigation,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 9, pp. 168-176, 1987.
[22] J. Sato and R. Cipolla, “Group Transformations from Image Moments,” Computer Vision and Image Understanding, vol. 73, pp. 29-42, 1999.
[23] H.S. Sawhney and R. Kumar, “True Multi-Image Alignment and Its Application to Mosaicing and Lens Distortion Correction,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 450-456, June 1997.
[24] J. Segman, J. Rubinstein, and Y. Zeevi, “The Canonical Coordinates Method for Pattern Deformation: Theoretical and Computational Considerations,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 14, pp. 1171-1183, 1992.
[25] H.Y. Shum and R. Szeliski, “Systems and Experiment Paper: Construction of Panoramic Image Mosaics with Global and Local Alignment,” Int'l J. Computer Vision, vol. 36, pp. 101-130, 2000.
[26] T. Pajdla and V. Hlavac, “Zero Phase Representation of Panoramic Images for Image Based Localization,” Proc. Int'l Conf. Computer Analysis of Images and Patterns, pp. 550-557, Sept. 1999.

Index Terms:
Rotation estimation, signal processing, spherical imaging, alignment, registration, global motion estimation.
Ameesh Makadia, Kostas Daniilidis, "Rotation Recovery from Spherical Images without Correspondences," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 28, no. 7, pp. 1170-1175, July 2006, doi:10.1109/TPAMI.2006.150
Usage of this product signifies your acceptance of the Terms of Use.