This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Fast and Accurate Algorithms for Projective Multi-Image Structure from Motion
June 2001 (vol. 23 no. 6)
pp. 546-559

Abstract—We describe algorithms for computing projective structure and motion from a multi-image sequence of tracked points. The algorithms are essentially linear, work for any motion of moderate size, and give accuracies similar to those of a maximum-likelihood estimate. They give better results than the Sturm/Triggs factorization approach and are equally fast and they are much faster than bundle adjustment. Our experiments show that the (iterated) Sturm/Triggs approach often fails for linear camera motions. In addition, we study experimentally the common situation where the calibration is fixed and approximately known, comparing the projective versions of our algorithms to mixed projective/Euclidean strategies. We clarify the nature of dominant-plane compensation, showing that it can be considered a small-translation approximation rather than an approximation that the scene is planar. We show that projective algorithms accurately recover the (projected) inverse depths and homographies despite the possibility of transforming the structure and motion by a projective transformation.

[1] R. Berthilsson, A. Heyden, and G. Sparr, “Recursive Structure and Motion from Image Sequences Using Shape and Depth Spaces,” Computer Vision and Pattern Recognition, pp. 444-449, 1997.
[2] A. Chiuso, R. Brockett, and S. Soatto, “Optimal Structure from Motion: Local Ambiguities and Global Estimates,” technical report, Washington Univ., 1999.
[3] R. Dutta, R. Manmatha, L.R. Williams, and E.M. Riseman, “A Data Set for Quantitative Motion Analysis,” Proc. Conf. Computer Vision and Pattern Recognition, pp. 159–164, 1989.
[4] G. Golub and C.F. Van Loan, Matrix Computations. Baltimore: Johns Hopkins Press, 1983.
[5] K. Hanna, "Direct Multi-Resolution Estimation of Ego-Motion and Structure from Motion," IEEE Workshop Visual Motion, pp. 156-162,Princeton, N.J., Oct. 1991.
[6] R.I. Hartley, In Defense of the 8-Point Algorithm IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 19, no. 6, pp. 580-593, June 1997.
[7] A. Heyden, “Projective Structure and Motion from Image Sequences Using Subspace Methods,” Proc. Scandinavian Conf. Image Analysis II, pp. 963-968, 1997.
[8] B.K.P. Horn and E.J. WeldonJr., “Direct Methods for Recovering Motion,” Int'l J. Computer Vision, vol. 2, no. 1, pp. 51-76, 1988.
[9] M. Irani and P. Anandan, “A Unified Approach to Moving Object Detection in 2D and 3D Scenes,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 20, no. 6, pp. 577-589, June 1998.
[10] A.D. Jepson and D.J. Heeger, “Linear Subspace Methods for Recovering Translational Direction,” Spatial Vision in Humans and Robots, pp. 39–62, Cambridge Univ. Press, 1993.
[11] R. Kumar, P. Anandan, and K. Hanna, “Direct Recovery of Shape from Multiple Views: A Parallax Based Approach,” Proc. Int'l Conf. Pattern Recognition, pp. 685-688, Oct. 1994.
[12] R. Kumar and A.R. Hanson, “Sensitivity of the Pose Refinement Problem to Accurate Estimation of Camera Parameters,” Proc. Int'l Conf. Computer Vision, pp. 365 369, 1990.
[13] W.J. MacLean, “Removal of Translation Bias When Using Subspace Methods,” Proc. IEEE Int'l Conf. Computer Vision, vol. II, pp. 753–758, 1999.
[14] J. Oliensis, “A Critique of Structure from Motion Algorithms,” Computer Vision and Image Understanding, to appear.
[15] J. Oliensis and Y. Genc, “Three Algorithms for 2-Image and$\geq 2\hbox{-}{\rm{Image}}$Structure from Motion,” technical report, NEC Inst., 2000, extended version of “New Algorithms for Two-Frame Structure from Motion,” Proc. Int'l Conf. Computer Vision, pp. 737-744, 1999.
[16] J. Oliensis, “Fast and Accurate Self-Calibration,” Proc. Int'l Conf. Computer Vision, pp. 745-752, 1999.
[17] J. Oliensis, “A Multi-Frame Structure from Motion Algorithm under Perspective Projection,” Int'l J. Computer Vision, vol. 34 nos. 2/3, pp. 163–192, 1999.
[18] J. Oliensis, “A New Structure from Motion Ambiguity,” IEEE Pattern Analysis and Machine Intelligence, vol. 22, no. 7, pp. 685-700, July 2000.
[19] J. Oliensis, “Recovering Heading and Structure for Constant-Direction Motion,” technical report, NEC, 1997.
[20] J. Oliensis, “Direct Multi-Frame Structure from Motion for Hand-Held Cameras,” Proc. Int'l Conf. Pattern Recognition, vol. I, pp. 889-895, 2000.
[21] J. Oliensis and M. Werman, “Structure from Motion Using Points, Lines, and Intensities,” Computer Vision and Pattern Recognition, vol. 2, pp. 599-606, 2000.
[22] J. Oliensis and Y. Genc, “Fast Algorithms for Projective Multi-Frame Structure from Motion,” Proc. Int'l Conf. Computer Vision, pp. 536–543, 1999.
[23] J. Oliensis, “Computing the Camera Heading from Multiple Frames,” Proc. Conf. Computer Vision and Pattern Recognition, pp. 203–210, 1998. Expanded version in “Recovering Heading and Structure for Constant-Direction Motion,” NECI Technical Report, 1999.
[24] J. Oliensis, “Multiframe Structure from Motion in Perspective,” Proc. Workshop Representations of Visual Scenes, pp. 77–84, 1995.
[25] J. Oliensis, “A Linear Solution for Multiframe Structure from Motion,” Proc. Image Understanding Workshop, pp. 1225-1231, 1994.
[26] J. Oliensis, “Structure from Linear and Planar Motions,” Proc. Conf. Computer Vision and Pattern Recognition, pp. 335–342, 1996.
[27] H.S. Sawhney, "Simplifying Motion and Structure Analysis Using Planar Parallax and Image Warping," Proc. Int'l Conf. Pattern Recognition, 1994.
[28] S. Srinivasan, “Extracting Structure from Optical Flow Using the Fast Error Search Technique,” Int'l J. Computer Vision, vol. 37, no. 3, pp. 203-230, 2000.
[29] S. Srinivasan, “Fast Partial Search Solution to the 3D SFM Problem,” Proc. Int'l Conf. Computer Vision, pp. 528-535, 1999.
[30] P. Sturm and B. Triggs, “A Factorization Based Algorithm for Multi-Image Projective Structure and Motion,” Proc. European Conf. Computer Vision '96, vol. 2, pp. 709-720, 1996.
[31] C. Tomasi and T. Kanade, "Shape and Motion From Image Streams Under Orthography: A Factorization Method," Int'l J. Computer Vision, vol. 9, no. 2, pp. 137-154, 1992.
[32] B Triggs, P.F. McLauchlan, R.I. Hartley, and A.W. Fitzgibbon, “Special Sessions—Bundle Adjustment: A Modern Synthesis,” Lecture Notes in Computer Science, vol. 1883, pp. 298-372, 2000.
[33] B. Triggs, “Factorisation Methods for Projective Structure and Motion,” Proc. IEEE Int'l Conf. Computer Vision and Pattern Recognition, pp. 845-851, 1996.

Index Terms:
Projective multiframe structure from motion, structure from motion, projective geometry, factorization, linear algorithms, Sturm/Triggs factorization, dominant plane, bundle adjustment, shape from X, low level vision.
Citation:
John Oliensis, Yacup Genc, "Fast and Accurate Algorithms for Projective Multi-Image Structure from Motion," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 23, no. 6, pp. 546-559, June 2001, doi:10.1109/34.927457
Usage of this product signifies your acceptance of the Terms of Use.