This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Recursive Estimation of Motion, Structure, and Focal Length
June 1995 (vol. 17 no. 6)
pp. 562-575

Abstract—We present a formulation for recursive recovery of motion, pointwise structure, and focal length from feature correspondences tracked through an image sequence. In addition to adding focal length to the state vector, several representational improvements are made over earlier structure from motion formulations, yielding a stable and accurate estimation framework which applies uniformly to both true perspective and orthographic projection. Results on synthetic and real imagery illustrate the performance of the estimator.

[1] N. Ayache and O. Faugeras, “Maintaining Representations of the Environment of a Mobile Robot,” IEEE Trans. Robotics and Automation, vol. 5, no. 6, pp. 804-819, 1989.
[2] A. Azarbayejani,T. Starner,B. Horowitz,, and A. Pentland,“Visually controlled graphics,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 15, no. 6, pp. 602-605, June 1993. (Special Section on 3D Modeling in Image Analysis and Synthesis).
[3] A.J. Azarbayejani,T. Galyean,B. Horowitz,, and A. Pentland,Recursive estimation for CAD model recovery, 2nd CAD-based Vision Workshop, Feb. 1994,Los Alamitos, Calif., IEEE Computer Society, IEEE Computer Society Press,
[4] A. Azarbayejani, B. Horowitz, and A. Pentland, “Recursive Estimation of Structure and Motion Using the Relative Orientation Constraint,” Proc. Conf. Computer Vision and Pattern Recognition, pp. 294-299, 1993.
[5] T. Broida, S. Chandrashekhar, and R. Chellappa, "Recursive 3D Motion Estimation From a Monocular Image Sequence," IEEE Trans. Aerospace and Electronic Systems, vol. 26, no. 4, pp. 639-656, 1990
[6] T.J. Broida and R. Chellappa, "Estimation of Object Motion Parameters From Noisy Images," IEEE Trans. Pattern Analysis and Machine Intelligence, 1986, pp. 90-99.
[7] R.G. Brown,“Introduction to random signal analysis and Kalman Filtering,”New York, John Wiley&Sons, 1983.
[8] E.D. Dickmanns and V. Graefe, "Dynamic Monocular Machine Vision," Int'l J. Machine Vision and Applications, Vol. 1, 1988, pp. 223-240.
[9] R. Dutta,R. Manmatha,L.R. Williams,, and E.M. Riseman,“A data set for quantitative motion analysis,” 1989 IEEE Conf. on Computer Vision and Pattern Recognition, June 1989. IEEE Computer Society, Los Alamitos, Calif., IEEE Computer Society Press.
[10] O. Faugeras, "What can be seen in three dimensions with an uncalibrated stereo rig?" Second European Conf. Computer Vision, pp. 563-578, 1992.
[11] O.D. Faugeras,N. Ayache,, and B. Faverjon,“Building visual maps by combining noisy stereo measurements,” Proc. IEEE Conf. on Robotics and Automation,San Francisco, Calif.., Apr. 1986.
[12] Applied Optimal Estimation, A. Gelb, ed.,Cambridge, Mass, MIT Press, 1974.
[13] J. Heel,“Temporally integrated surface reconstruction,” ICCV’90, IEEE, 1990.
[14] B.K. Horn, Robot Vision. Cambridge, Mass.: MIT Press, 1986.
[15] B.K.P. Horn, “Relative Orientation,” Int'l J. Computer Vision, vol. 4, pp. 59-78, 1990.
[16] J. J. Koenderink and A. J. Van Doorn,“Affine structure from motion,” J. of the Optical Society of America, vol. 8, pp. 377-385, 1991.
[17] R. Kumar,H.S. Sawhney,, and A. R. Hanson,“3D model acquisition from monocular image sequences,” 1992 IEEE Conf. on Computer Vision and Pattern Recognition, pp. 209-215, June 1992.Los Alamitos, Calif., IEEE Computer Society Press.
[18] R.V.R. Kumar, A. Tirumalai, and R.C. Jain, "A Non-Linear Optimization Algorithm for the Estimation of Structure and Motion Parameters," Proc. IEEE Computer Vision and Pattern Recognition,San Diego, Calif., pp. 136-143, June4-8, 1989.
[19] H.C. Longuet-Higgens,“A computer algorithm for reconstructing a scene from two projections,” Nature, vol. 293, pp. 133-135, 1981.
[20] L. Matthies,T. Kanade,, and R. Szeliski,“Kalman filter based algorithms for estimating depth from image sequences,” Int’l J. of Computer Vision, vol. 3, no. 3, pp. 209-236, 1989.
[21] J. Oliensis and J.I. Thomas, "Incorporating Motion Error in Multi-Frame Structure From Motion, IEEE Workshop on Visual Motion, pp. 8-13, Princeton, N.J., Los Alamitos, Calif.: CS Press, Oct. 1991.
[22] C.J. Poelman and T. Kanade,“A paraperspective factorization method for shape and motion recovery,” CMU-CS 92-208, School of Computer Science, Carnegie Mellon Univ., Pittsburgh, Pennsylvania, Oct. 1992.
[23] A. Shashua,“Projective depth: A geometric invariant for 3D reconstruction from two perspective/orthographic views and for visual recognition,” Proc. Int’l Conf. Computer Vision, pp. 583-590,Berlin, May 1993.
[24] S. Soatto,P. Perona,R. Fraezza,, and G. Picci,“Recursive motion and structure estimation with complete error characterization,” 1993 IEEE Conf. on Computer Vision and Pattern Recognition, pp. 428-433,Los Alamitos, Calif., June 1993. IEEE Computer Society, IEEE Computer Society Press.
[25] M. Spetsakis and Y. Aloimonos,“A multi-frame approach to visual motion perception, Int’l J. of Computer Vision, vol. 6, no. 3, pp. 245-255, Aug. 1991.
[26] R. Szeliski and S.B. Kang, "Recovering 3D Shape and Motion from Image Streams Using Non-Linear Least Squares," IEEE CS, Conf. Computer Vision and Pattern Recognition,New York, N.Y., pp. 752-753, June 1993.
[27] R. Szeliski and S.B. Kang,“Recovering 3D shape and motion from image streams using non-linear least squares, CRL 93/3, Digital Equipment Corporation, Cambridge Research Labs, Cambridge, Mass., Mar. 1993.
[28] C. Tomasi and T. Kanade, "Shape and Motion From Image Streams Under Orthography: A Factorization Method," Int'l J. Computer Vision, vol. 9, no. 2, pp. 137-154, 1992.
[29] D. Weinshall and C. Tomasi, “Linear and Incremental Acquisition of Invariant Shape Models from Image Sequences,” Proc. Fourth Int'l Conf. Computer Vision, pp. 675-682, May 1993.
[30] J. Weng,N. Ahuja,, and T.S. Huang,“Optimal motion and structure estimation,” Proc. IEEE Conf. on Computer Vision and Pattern Recognition,San Diego, Calif., pp. 144-152, June 1989.
[31] J. Weng, N. Ahuja, and T. Huang, "Optimal Motion and Structure Estimation," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 15, no. 9, pp. 864-884, 1993.
[32] G.S. Young and R. Chellappa, “3-D Motion Estimation Using a Sequence of Noisy Stereo Images: Models, Estimation, and Uniqueness Results,” Trans. Pattern Analysis and Machine Intelligence, vol. 12, no. 8, pp. 735–759, Aug. 1990.

Index Terms:
Structure from motion, camera model, camera calibration, recursive estimation, 3D representation, 3D modeling.
Citation:
Ali Azarbayejani, Alex P. Pentland, "Recursive Estimation of Motion, Structure, and Focal Length," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 17, no. 6, pp. 562-575, June 1995, doi:10.1109/34.387503
Usage of this product signifies your acceptance of the Terms of Use.