This Article 
 Bibliographic References 
 Add to: 
A Paraperspective Factorization Method for Shape and Motion Recovery
March 1997 (vol. 19 no. 3)
pp. 206-218

Abstract—The factorization method, first developed by Tomasi and Kanade, recovers both the shape of an object and its motion from a sequence of images, using many images and tracking many feature points to obtain highly redundant feature position information. The method robustly processes the feature trajectory information using singular value decomposition (SVD), taking advantage of the linear algebraic properties of orthographic projection. However, an orthographic formulation limits the range of motions the method can accommodate. Paraperspective projection, first introduced by Ohta, is a projection model that closely approximates perspective projection by modeling several effects not modeled under orthographic projection, while retaining linear algebraic properties. Our paraperspective factorization method can be applied to a much wider range of motion scenarios, including image sequences containing motion toward the camera and aerial image sequences of terrain taken from a low-altitude airplane.

[1] J.Y. Aloimonos, "Perspective Approximations," Image and Vision Computing, vol. 8, no. 3, pp. 177-192, Aug. 1990.
[2] T. Broida, S. Chandrashekhar, and R. Chellappa, "Recursive 3D Motion Estimation From a Monocular Image Sequence," IEEE Trans. Aerospace and Electronic Systems, vol. 26, no. 4, pp. 639-656, 1990
[3] J. Costeira and T. Kanade, "A Multi-Body Factorization Method for Motion Analysis," Technical Report CMU-CS-TR-94-220, Carnegie Mellon Univ., Pittsburgh PA, Sept. 1994.
[4] B.D. Lucas and T. Kanade, "An Iterative Image Registration Technique with an Application to Stereo Vision," Proc. Seventh Int'l Joint Conf. Artificial Intelligence, 1981.
[5] J.L. Mundy and A. Zisserman, Geometric Invariance in Computer Vision. MIT Press, 1992, p. 512.
[6] Y. Ohta, K. Maenobu, and T. Sakai, "Obtaining Surface Orientation from Texels Under Perspective Projection," Proc. Seventh Int'l Joint Conf. Artificial Intelligence, pp. 746-751, Aug. 1981.
[7] C.J. Poelman and T. Kanade, "A Paraperspective Factorization Method for Shape and Motion Recovery," Technical Report CMU-CS-93-219, Carnegie Mellon Univ., Pittsburgh, PA, Dec. 1993.
[8] W.H. Press, B.P. Flannery, S.A. Teukolsky, and W.T. Vetterling, Numerical Recipes in C: The Art of Scientific Computing. Cambridge Univ. Press, 1988.
[9] L. Quan, "Self-Calibration of an Affine Camera from Multiple Views," Technical Report R.T. Imag-Lifia 26, LIFIA-CNRS-INRIA, Grenoble, France, Nov. 1994.
[10] A. Ruhe and P.A. Wedin, "Algorithms for Separable Nonlinear Least Squares Problems," SIAM Review, vol. 22, no. 3, July 1980.
[11] R. Szeliski and S.B. Kang, "Recovering 3D Shape and Motion from Image Streams Using Non-Linear Least Squares," Technical Report 93/3, Digital Equipment Corporation, Cambridge Research Lab, Mar. 1993.
[12] C. Taylor, D. Kriegman, and P. Anandan, "Structure and Motion from Multiple Images: A Least Squares Approach," IEEE Workshop on Visual Motion, pp. 242-248, Oct. 1991.
[13] C. Tomasi, "Shape and Motion from Image Streams: A Factorization Method," Technical Report CMU-CS-91-172, Carnegie Mellon University, Pittsburgh, PA, Sept. 1991.
[14] C. Tomasi and T. Kanade, "Shape and Motion from Image Streams Under Orthography: A Factorization Method," Int'l J. Computer Vision, vol. 9, no. 2, pp. 137-154, Nov. 1992.
[15] R. Tsai and T. Huang, "Uniqueness and Estimation of Three-Dimensional Motion Parameters of Rigid Objects with Curved Surfaces," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 6, no. 1, pp. 13-27, Jan. 1984.
[16] D. Weinshall and C. Tomasi, “Linear and Incremental Acquisition of Invariant Shape Models from Image Sequences,” Proc. Fourth Int'l Conf. Computer Vision, pp. 675-682, May 1993.

Index Terms:
Motion analysis, shape recovery, factorization method, three-dimensional vision, image sequence analysis, singular value decomposition.
Conrad J. Poelman, Takeo Kanade, "A Paraperspective Factorization Method for Shape and Motion Recovery," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 19, no. 3, pp. 206-218, March 1997, doi:10.1109/34.584098
Usage of this product signifies your acceptance of the Terms of Use.