This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
An Efficient Solution to the Five-Point Relative Pose Problem
June 2004 (vol. 26 no. 6)
pp. 756-777

Abstract—An efficient algorithmic solution to the classical five-point relative pose problem is presented. The problem is to find the possible solutions for relative camera pose between two calibrated views given five corresponding points. The algorithm consists of computing the coefficients of a tenth degree polynomial in closed form and, subsequently, finding its roots. It is the first algorithm well-suited for numerical implementation that also corresponds to the inherent complexity of the problem. We investigate the numerical precision of the algorithm. We also study its performance under noise in minimal as well as overdetermined cases. The performance is compared to that of the well-known 8 and 7-point methods and a 6-point scheme. The algorithm is used in a robust hypothesize-and-test framework to estimate structure and motion in real-time with low delay. The real-time system uses solely visual input and has been demonstrated at major conferences.

[1] P. Beardsley, A. Zisserman, and D. Murray, Sequential Updating of Projective and Affine Structure from Motion Int'l J. Computer Vision, vol. 23, no. 3, pp. 235-259, 1997.
[2] O. Chum and J. Matas, Randomized RANSAC with$T_{d,d}$Test Proc. British Machine Vision Conf., pp. 448-457, 2002.
[3] M. Demazure, Sur Deux Problemes de Reconstruction Technical Report No. 882, INRIA, France, 1988.
[4] O. Faugeras and S. Maybank, Motion from Point Matches: Multiplicity of Solutions Int'l J. Computer Vision, vol. 4, no. 3, pp. 225-246, 1990.
[5] O. Faugeras, What Can Be Seen in Three Dimensions with an Uncalibrated Stereo Rig? Proc. European Conf. Computer Vision, pp. 563-578, 1992.
[6] O. Faugeras, Three-Dimensional Computer Vision: A Geometric Viewpoint. MIT Press, 1993.
[7] A. Fitzgibbon and A. Zisserman, Automatic Camera Recovery for Closed or Open Image Sequences Proc. European Conf. Computer Vision, pp. 311-326, 1998.
[8] M. Fischler and R. Bolles, Random Sample Consensus: A Paradigm for Model Fitting with Application to Image Analysis and Automated Cartography Comm. ACM, vol. 24, pp. 381-395, 1981.
[9] W. Gellert, K. Küstner, M. Hellwich, and H. Kastner, The VNR Concise Encyclopedia of Mathematics. Van Nostrand Reinhold Company, 1975.
[10] A. Gruen and T. Huang, Calibration and Orientation of Cameras in Computer Vision. Springer Verlag, 2001.
[11] R. Haralick, C. Lee, K. Ottenberg, and M. Nölle, Review and Analysis of Solutions of the Three Point Perspective Pose Estimation Problem Int'l J. Computer Vision, vol. 13, no. 3, pp. 331-356, 1994.
[12] R. Hartley, Estimation of Relative Camera Positions for Uncalibrated Cameras Proc. European Conf. Computer Vision, pp. 579-587, 1992.
[13] R.I. Hartley, In Defense of the 8-Point Algorithm IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 19, no. 6, pp. 580-593, June 1997.
[14] R. Hartley and A. Zisserman, Multiple View Geometry in Computer Vision. Cambridge Univ. Press, 2000.
[15] D. Heeger and A. Jepson, Subspace Methods for Recovering Rigid Motion Int'l J. Computer Vision, vol. 7, no. 2, pp. 95-117, 1992.
[16] A. Heyden and G. Sparr, Reconstruction from Calibrated Cameras A New Proof of the Kruppa-Demazure Theorem J. Math. Imaging&Vision, vol. 10, pp. 1-20, 1999.
[17] D. Hook and P. McAree, Using Sturm Sequences to Bracket Real Roots of Polynomial Equations Graphic Gems I, Academic Press, pp. 416-423, 1990.
[18] B. Horn, Relative Orientation Int'l J. Computer Vision, vol. 4, pp. 59-78, 1990.
[19] E. Kruppa, Zur Ermittlung eines Objektes aus Zwei Perspektiven mit Innerer Orientierung Sitz.-Ber. Akad. Wiss., Wien, Math. Naturw. Kl., Abt. IIa., vol. 122, pp. 1939-1948, 1913.
[20] H. Longuet-Higgins, A Computer Algorithm for Reconstructing a Scene from Two Projections Nature, vol. 293, no. 10, pp. 133-135, 1981.
[21] H. Longuet-Higgins, The Reconstruction of a Plane Surface from Two Perspective Projections Proc. Royal Soc. London B, vol. 277, pp. 399-410, 1986.
[22] S. Maybank, Theory of Reconstruction from Image Motion. Springer Verlag, 1993.
[23] S. Negahdaripour, Closed-Form Relationship Between the Two Interpretations of a Moving Plane J. Optical Soc. of Am., vol. 7, no. 2, pp. 279-285, 1990.
[24] D. Nistér, Reconstruction from Uncalibrated Sequences with a Hierarchy of Trifocal Tensors Proc. European Conf. Computer Vision, pp. 649-663, 2000.
[25] D. Nistér, Automatic Dense Reconstruction from Uncalibrated Video Sequences PhD thesis, Royal Inst. of Technology KTH, Mar. 2001.
[26] D. Nistér, Preemptive RANSAC for Live Structure and Motion Estimation Proc. Int'l Conf. Computer Vision, pp. 199-206, 2003.
[27] D. Nistér, An Efficient Solution to the Five-Point Relative Pose Problem Proc. Computer Vision and Pattern Recognition, pp. 195-202, 2003.
[28] D. Nistér, Live Structure and Motion Estimation Proc. Computer Vision and Pattern Recognition, 2003.
[29] D. Nistér, Live Ego-Motion Estimation Proc. Int'l Conf. Computer Vision, 2003.
[30] J. Oliensis and Y. Genc, “New Algorithms for Two-Frame Structure from Motion,” NECI technical report, 2000. Expanded version of Proc. Int'l Conf. Computer Vision, pp. 737–744, 1999.
[31] J. Oliensis, A Critique of Structure from Motion Algorithms Computer Vision and Image Understanding, vol. 80, pp. 172-214, 2000.
[32] J. Philip, A Non-Iterative Algorithm for Determining All Essential Matrices Corresponding to Five Point Pairs Photogrammetric Record, vol. 15, no. 88, pp. 589-599, 1996.
[33] J. Philip, Critical Point Configurations of the 5-, 6-, 7-, and 8-point Algorithms for Relative Orientation TRITA-MAT-1998-MA-13, Feb. 1998.
[34] M. Pollefeys, R. Koch, and L. Van Gool, Self-Calibration and Metric Reconstruction in Spite of Varying and Unknown Internal Camera Parameters, Int'l J. Computer Vision, vol. 32, no. 1, pp. 7-25, 1999.
[35] M. Pollefeys, F. Verbiest, and L. Van Gool, Surviving Dominant Planes in Uncalibrated Structure and Motion Recovery Proc. European Conf. Computer Vision, pp. 837-851, 2002.
[36] W. Press, S. Teukolsky, W. Vetterling, and B. Flannery, Numerical Recipes in C, Cambridge Univ. Press, 1988.
[37] J. Semple and G. Kneebone, Algebraic Projective Geometry. Oxford Univ. Press, 1952.
[38] P. Stefanovic, Relative Orientation-A New Approach I.T.C.J., vol. 3, pp. 417-448, 1973.
[39] R. Sturm, Das Problem der Projektivität und seine Anwendung auf die Flächen Zweiten Grades Math. Annalen 1, pp. 533-573, 1869.
[40] T.Y. Tian, C. Tomasi, and D.J. Heeger, “Comparison of Approaches to Egomotion Computation,” Proc. Conf. Computer Vision and Pattern Recognition, pp. 315–320, 1996.
[41] P. Torr and D. Murray, The Development and Comparison of Robust Methods for Estimating the Fundamental Matrix Int'l J. Computer Vision, vol. 24, no. 3, pp. 271-300, 1997.
[42] P. Torr and A. Zisserman, Robust Parameterization and Computation of the Trifocal Tensor Image and Vision Computing, vol. 15, pp. 591-605, 1997.
[43] P. Torr, A. Fitzgibbon, and A. Zisserman, The Problem of Degeneracy in Structure and Motion Recovery from Uncalibrated Image Sequences Int'l J. Computer Vision, vol. 32, no. 1, pp. 27-44, 1999.
[44] B. Triggs, Routines for Relative Pose of Two Calibrated Cameras from 5 Points technical report, http://www.inrialpes.fr/ movi/peopleTriggsINRIA, France, 2000.
[45] B. Triggs, P. McLauchlan, R. Hartley, and A. Fitzgibbon, Bundle Adjustment-A Modern Synthesis Lecture Notes in Computer Science, vol. 1883, pp. 298-375, 2000.
[46] R. Tsai and T. Huang, Uniqueness and Estimation of Three-Dimensional Motion Parameters of Rigid Objects with Curved Surfaces IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 6, no. 1, pp. 13-27, 1984.
[47] H. von Sanden, Die Bestimmung der Kernpunkte in der Photogrammetrie PhD thesis, Univ. of Gottingen, 1908.
[48] Z. Zhang, Determining the Epipolar Geometry and Its Uncertainty: A Review Int'l J. Computer Vision, vol. 27, no. 2, pp. 161-195, 1998.
[49] Z.Y. Zhang, A Flexible New Technique for Camera Calibration Proc. Int'l Conf. Computer Vision, vol. 1, pp. 666-673, Sept. 1999.

Index Terms:
Imaging geometry, motion, relative orientation, structure from motion, camera calibration, ego-motion estimation, scene reconstruction.
Citation:
David Nist?, "An Efficient Solution to the Five-Point Relative Pose Problem," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 26, no. 6, pp. 756-777, June 2004, doi:10.1109/TPAMI.2004.17
Usage of this product signifies your acceptance of the Terms of Use.