This Article 
 Bibliographic References 
 Add to: 
Minimal Projective Reconstruction Including Missing Data
April 2001 (vol. 23 no. 4)
pp. 418-424

Abstract—The minimal data necessary for projective reconstruction from image points is well-known when each object point is visible in all images. In this paper, we formulate and propose solutions to a new family of reconstruction problems for multiple images from minimal data, where there are missing points in some of the images. The ability to handle the minimal cases with missing data is of great theoretical and practical importance. It is unavoidable to use them to bootstrap robust estimation such as RANSAC and LMS algorithms and optimal estimation such as bundle adjustment. First, we develop a framework to parameterize the multiple view geometry needed to handle the missing data cases. Then, we present a solution to the minimal case of eight points in three images, where one different point is missing in each of the three images. We prove that there are, in general, as many as 11 solutions for this minimal case. Furthermore, all minimal cases with missing data for three and four images are catalogued. Finally, we demonstrate the method on both simulated and real images and show that the algorithms presented in this paper can be used for practical problems.

[1] K.B. Atkinson, Close Range Photogrammetry and Machine Vision. Whittles Publishing, 1996.
[2] S. Carlsson and D. Weinshall, Dual Computation of Projective Shape and Camera Positions from Multiple Images Int'l J. Computer Vision, vol. 27, no. 3, pp. 227-241, May 1998.
[3] D. Cox, J. Little, and D. O'Shea, Ideals, Varities, and Algorithms. New York: Springer-Verlag, 1992.
[4] O. Faugeras, "What can be seen in three dimensions with an uncalibrated stereo rig?" Second European Conf. Computer Vision, pp. 563-578, 1992.
[5] O.D. Faugeras and S. Maybank, “Motion from Point Matches: Multiplicity of Solutions,” Technical Report 1157, INRIA, Rocquencourt, France, 1990.
[6] M.A. Fischler and R.C. Bolles, “Random Sample Consensus: A Paradigm for Model Fitting with Applications to Image Analysis and Automated Cartography,” Graphics and Image Processing, vol. 24, no. 6, pp. 381–395, June 1981.
[7] R. Hartley, R. Gupta, and T. Chang, “Stereo from Uncalibrated Cameras,” Proc. Conf. Computer Vision and Pattern Recognition, pp. 761-764, June 1992.
[8] R. Hartley and A. Zisserman, Multiple View Geometry in Computer Vision. Cambridge Univ. Press, 2000.
[9] A. Heyden, “Geometry and Algebra of Multipe Projective Transformations,” PhD thesis, Lund Inst. Technology, Sweden, 1995.
[10] A. Heyden and K. Åström, “Flexible Calibration: Minimal Cases for Auto-Calibration,” Int'l Conf. Computer Vision, pp. 350-355, 1999.
[11] F. Kahl and A. Heyden, “Affine Structure and Motion from Points, Lines, and Conics,” Int'l J. Computer Vision, vol. 33, no. 3, pp. 163-180, 1999.
[12] Y. Ma, S. Soatto, J. Kosecká, and S. Sastry, “Euclidean Reconstruction and Reprojection up to Subgroups,” Int'l J. Computer Vision, vol. 38, no. 3, pp. 219-229, 2000.
[13] S.J. Maybank and O.D. Faugeras, “A Theory of Self-Calibration of a Moving Camera,” Int'l J. Computer Vision, vol. 8. no. 2, pp. 123-152, Aug. 1992.
[14] L. Quan, "Invariant of a pair of non-coplanar conics in space: Definition, geometric interpretation and computation," Proc. Fifth Int'l Conf. Computer Vision, pp. 926-931,Cambridge, Mass., 1995.
[15] L. Quan, Invariants of Six Points and Projective Reconstruction from Three Uncalibrated Images IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 17, no. 1, pp. 34-46, Jan. 1995.
[16] A. Shashua and M. Werman, "Trilinearity of Three Perspective Views and Its Associated Tensor," Proc. Int'l Conf. Computer Vision, June 1995.
[17] R. Sturm, “Das Problem der Projektivität und seine Anwendung auf dieFlächen Zweiten Grades,” Math. Ann., vol. 1, pp. 533-574, 1869.
[18] C. Tomasi and T. Kanade, "Shape and Motion From Image Streams Under Orthography: A Factorization Method," Int'l J. Computer Vision, vol. 9, no. 2, pp. 137-154, 1992.
[19] P.H.S. Torr and A. Zisserman, “Robust Parameterization and Computation of the Trifocal Tensor,” Image and Vision Computing, vol. 15, no. 8, pp. 591-605, 1997.
[20] B. Triggs, “Autocalibration and the Absolute Quadric,” Proc. Conf. Computer Vision and Pattern Recognition, pp. 609-614, June 1997.
[21] B. Triggs, “Linear Projective Reconstruction from Matching Tensors,” Image and Vision Computing, vol. 15, no. 8, pp. 617-625, 1997.
[22] Z. Zhang, R. Deriche, O.D. Faugeras, and Q.T. Luong, “A Robust Technique for Matching Two Uncalibrated Images through the Recovery of the Unknown Apipolar Geometry,” technical teport, INRIA, Rocquencourt, France, 1994.

Index Terms:
Structure recovery, projective reconstruction, structure from motion, projective geometry, missing data.
Fredrik Kahl, Anders Heyden, Long Quan, "Minimal Projective Reconstruction Including Missing Data," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 23, no. 4, pp. 418-424, April 2001, doi:10.1109/34.917578
Usage of this product signifies your acceptance of the Terms of Use.