Subscribe
Issue No.10 - Oct. (2013 vol.35)
pp: 2387-2400
A. Penate-Sanchez , Inst. de Roboticai Inf. Ind., UPC, Barcelona, Spain
J. Andrade-Cetto , Inst. de Roboticai Inf. Ind., UPC, Barcelona, Spain
F. Moreno-Noguer , Inst. de Roboticai Inf. Ind., UPC, Barcelona, Spain
ABSTRACT
We propose a novel approach for the estimation of the pose and focal length of a camera from a set of 3D-to-2D point correspondences. Our method compares favorably to competing approaches in that it is both more accurate than existing closed form solutions, as well as faster and also more accurate than iterative ones. Our approach is inspired on the EPnP algorithm, a recent O(n) solution for the calibrated case. Yet we show that considering the focal length as an additional unknown renders the linearization and relinearization techniques of the original approach no longer valid, especially with large amounts of noise. We present new methodologies to circumvent this limitation termed exhaustive linearization and exhaustive relinearization which perform a systematic exploration of the solution space in closed form. The method is evaluated on both real and synthetic data, and our results show that besides producing precise focal length estimation, the retrieved camera pose is almost as accurate as the one computed using the EPnP, which assumes a calibrated camera.
INDEX TERMS
Equations, Cameras, Noise, Vectors, Estimation, Kernel, Linear systems,perspective-n-point problem, Camera calibration
CITATION
A. Penate-Sanchez, J. Andrade-Cetto, F. Moreno-Noguer, "Exhaustive Linearization for Robust Camera Pose and Focal Length Estimation", IEEE Transactions on Pattern Analysis & Machine Intelligence, vol.35, no. 10, pp. 2387-2400, Oct. 2013, doi:10.1109/TPAMI.2013.36
REFERENCES
 [1] A. Ansar and K. Daniilidis, "Linear Pose Estimation from Points or Lines," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 25, no. 5, pp. 578-589, May 2003. [2] M. Bujnak, Z. Kukelova, and T. Pajdla, "A General Solution to the P4P Problem for Camera with Unknown Focal Length," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 1-8, 2008. [3] M. Bujnak, Z. Kukelova, and T. Pajdla, "Robust Focal Length Estimation by Voting in Multi-View Scene Reconstruction," Proc. Ninth Asian Conf. Computer Vision, pp. 13-24, 2009. [4] M. Bujnak, Z. Kukelova, and T. Pajdla, "New Efficient Solution to the Absolute Pose Problem for Camera with Unknown Focal Length and Radial Distortion," Proc. 10th Asian Conf. Computer Vision, pp. 11-24, 2010. [5] M. Byrod, Z. Kukelova, K. Josephson, T. Pajdla, and K. Astrom, "Fast and Robust Numerical Solutions to Minimal Problems for Cameras with Radial Distortion," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 1-8, 2008. [6] K. Choi, S. Lee, and Y. Seo, "A Branch-and-Bound Algorithm for Globally Optimal Camera Pose and Focal Length," Image and Vision Computing, vol. 28, no. 9, pp. 1369-1376, 2010. [7] D. DeMenthon and L.S. Davis, "Model-Based Object Pose in 25 Lines of Code," Int'l J. Computer Vision, vol. 15, nos. 1-2, pp. 123-141, 1995. [8] P.D. Fiore., "Efficient Linear Solution of Exterior Orientation," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 23, no. 2, pp. 140-148, Feb. 2001. [9] M.A. Fischler and R.C. Bolles, "Random Sample Consensus: A Paradigm for Model Fitting with Applications to Image Analysis and Automated Cartography," Comm. ACM, vol. 24, no. 6, pp. 381-395, 1981. [10] X.-S. Gao, X.-R. Hou, J. Tang, and H.-F. Cheng, "Complete Solution Classification for the Perspective-Three-Point Problem," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 25, no. 8, pp. 930-943, Aug. 2003. [11] R. Hartley and A. Zisserman, Multiple View Geometry in Computer Vision, second ed. Cambridge Univ. Press, 2004. [12] R. Horaud, F. Dornaika, B. Lamiroy, and S. Christy, "Object Pose: The Link between Weak Perspective, Paraperspective, and Full Perspective," Int'l J. Computer Vision, vol. 22, no. 2, pp. 173-189, 1997. [13] B.K.P. Horn, H.M. Hilden, and S. Negahdaripour, "Closed-Form Solution of Absolute Orientation Using Orthonormal Matrices," J. Optical Soc. Am., vol. 5, no. 7, pp. 1127-1135, 1988. [14] K. Josephson and M. Byrod, "Pose Estimation with Radial Distortion and Unknown Focal Length," Proc. IEEE Conf. Computer Vision and Pattern Recognition, vol. 2, pp. 2419-2426, 2009. [15] F. Kahl, S. Agarwal, M. Chandraker, D. Kriegman, and S. Belongie, "Practical Global Optimization for Multiview Geometry," Int'l J. Computer Vision, vol. 79, no. 3, pp. 271-284, 2008. [16] F. Kahl and R. Hartley, "Multiple-View Geometry Under the $L_{\infty }$ -Norm," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 30, no. 9, pp. 1603-1617, Sept. 2008. [17] A. Kipnis and A. Shamir, "Cryptanalysis of the HFE Public Key Cryptosystem by Relinearization," Proc. 19th Ann. Int'l Cryptology Conf. Advances in Cryptology, pp. 19-30, 1999. [18] Z. Kukelova, M. Bujnak, and T. Pajdla, "Polynomial Eigenvalue Solutions to the 5-pt and 6-pt Relative Pose Problems," Proc. British Machine Vision Conf., pp. 56.1-56.10, 2008. [19] V. Lepetit and P. Fua, "Keypoint Recognition Using Randomized Trees," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 28, no. 9, pp. 1465-1479, Sept. 2006. [20] V. Lepetit, F. Moreno-Noguer, and P. Fua, "EPnP: An Accurate O(n) Solution to the PnP Problem," Int'l J. Computer Vision, vol. 81, no. 2, pp. 151-166, 2008. [21] C.P. Lu, G.D. Hager, and E. Mjolsness, "Fast and Globally Convergent Pose Estimation from Video Images," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 22, no. 6, pp. 610-622, June 2000. [22] F. Moreno-Noguer, V. Lepetit, and P. Fua, "Accurate Non-Iterative O(n) Solution to the PnP Problem," Proc. 11th IEEE Int'l Conf. Computer Vision, pp. 1-8, 2007. [23] M. Salzmann, V. Lepetit, and P. Fua, "Deformable Surface Tracking Ambiguities," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 1-8, 2007. [24] G. Schweighofer and A. Pinz, "Robust Pose Estimation from a Planar Target," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 28, no. 12, pp. 2024-2030, Dec. 2006. [25] H. Stewenius, D. Nister, F. Kahl, and F. Schaffalitzky, "A Minimal Solution for Relative Pose with Unknown Focal Length," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 789-794, 2005. [26] T. Thang-Pham, T.J. Chin, J. Yu, and D. Sutter, "The Random Cluster Model for Robust Geometric Fitting," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 710-717, 2012. [27] B. Triggs, "Camera Pose and Calibration from 4 or 5 Known Three-Dimensional Points," Proc. IEEE Int'l Conf. Computer Vision, pp. 278-284, 1999. [28] B. Williams, G. Klein, and I. Reid, "Real-Time SLAM Relocalisation," Proc. IEEE Int'l Conf. Computer Vision, pp. 1-8, 2007. [29] Z. Zhang, "A Flexible New Technique for Camera Calibration," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 22, no. 11, pp. 1330-1334, Nov. 1998.