Subscribe
Issue No.12 - December (2011 vol.33)
pp: 2410-2422
Zuzana Kukelova , Czech Technical University in Prague, Prague
Tomas Pajdla , Czech Technical University in Prague, Prague
ABSTRACT
Simultaneous estimation of radial distortion, epipolar geometry, and relative camera pose can be formulated as a minimal problem and solved from a minimal number of image points. Finding the solution to this problem leads to solving a system of algebraic equations. In this paper, we provide two different solutions to the problem of estimating radial distortion and epipolar geometry from eight point correspondences in two images. Unlike previous algorithms which were able to solve the problem from nine correspondences only, we enforce the determinant of the fundamental matrix be zero. This leads to a system of eight quadratic and one cubic equation in nine variables. We first simplify this system by eliminating six of these variables and then solve the system by two alternative techniques. The first one is based on the Gröbner basis method and the second one on the polynomial eigenvalue computation. We demonstrate that our solutions are efficient, robust, and practical by experiments on synthetic and real data.
INDEX TERMS
Minimal problems, radial distortion, Gröbner bases, polynomial eigenvalue problems.
CITATION
Zuzana Kukelova, Tomas Pajdla, "A Minimal Solution to Radial Distortion Autocalibration", IEEE Transactions on Pattern Analysis & Machine Intelligence, vol.33, no. 12, pp. 2410-2422, December 2011, doi:10.1109/TPAMI.2011.86
REFERENCES
 [1] Z. Bai, J. Demmel, J. Dongorra, A. Ruhe, and H. van der Vorst, Templates for the Solution of Algebraic Eigenvalue Problems. SIAM, 2000. [2] J. Barreto and K. Daniilidis, "Fundamental Matrix for Cameras with Radial Distortion," Proc. IEEE Int'l Conf. Computer Vision, Oct. 2005. [3] J. Barreto, J. Roquette, P. Sturm, and F. Fonseca, "Automatic Camera Calibration Applied to Medical Endoscopy," Proc. British Machine Vision Conf., 2009. [4] C. Bräuer-Burchardt and K. Voss, "A New Algorithm to Correct Fish-Eye and Strong Wide-Angle-Lens-Distortion from Single Images," Proc. Int'l Conf. Image Processing, pp. 225-228, 2001. [5] M. Bujnak, Z. Kukelova, and T. Pajdla, "A General Solution to the P4P Problem for Camera with Unknown Focal Length," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2008. [6] M. Bujnak, Z. Kukelova, and T. Pajdla, "Robust Focal Length Estimation by Voting in Multiview Scenes," Proc. Asian Conf. Computer Vision, 2009. [7] M. Bujnak, Z. Kukelova, and T. Pajdla, "New Efficient Solution to the Absolute Pose Problem for Camera with Unknown Focal Length and Radial Distortion," Proc. Asian Conf. Computer Vision, 2010. [8] M. Byröd, K. Josephson, and K. Åström, "Improving Numerical Accuracy of Gröbner Basis Polynomial Equation Solver," Proc. IEEE Int'l Conf. Computer Vision, 2007. [9] M. Byröd, Z. Kukelova, K. Josephson, T. Pajdla, and K. Åström, "Fast and Robust Numerical Solutions to Minimal Problems for Cameras with Radial Distortion," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2008. [10] M. Byröd, M. Brown, and K. Åström, "Minimal Solutions for Panoramic Stitching with Radial Distortion," Proc. 20th British Machine Vision Conf., 2009. [11] D. Claus and A. Fitzgibbon, "A Rational Function Lens Distortion Model for General Cameras," Proc. IEEE CS Conf. Computer Vision and Pattern Recognition, vol. 1, pp. 213-219, 2005. [12] D. Cox, J. Little, and D. O'Shea, Using Algebraic Geometry, second ed. Springer Verlag, 2005. [13] D. Devernay and O. Faugeras, "Straight Lines Have to Be Straight," Machine Vision and Applications , vol. 13, no. 1, pp. 14-24, 2001. [14] F. Du and J.M. Brady, "Self-Calibration of the Intrinsic Parameters of Cameras for Active Vision Systems," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 477-482, 1993. [15] M.A. Fischler and R.C. Bolles, "Random Sample Consensus: A Paradigm for Model Fitting with Applications to Image Analysis and Automated Cartography," Comm. ACM, vol. 24, no. 6, pp. 381-395, 1981. [16] A. Fitzgibbon, "Simultaneous Linear Estimation of Multiple View Geometry and Lens Distortion," Proc. IEEE CS Conf. Computer Vision and Pattern Recognition, pp. 125-132, 2001. [17] J.-C. Faugère, "A New Efficient Algorithm for Computing Gröbner Bases ($f_4$ )," J. Pure and Applied Algebra, vol. 139, nos. 1-3, pp. 61-88, 1999. [18] X.-S. Gao, X.-R. Hou, J. Tang, and H.-F. Cheng, "Complete Solution Classification for the Perspective-Three-Point Problem," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 25, no. 8, pp. 930-943, Aug. 2003. [19] C. Geyer and H. Stewenius, "A Nine-Point Algorithm for Estimating Para-Catadioptric Fundamental Matrices," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2007. [20] D.B. Gennery, "Generalized Camera Calibration Including Fish-Eye Lenses," Int'l J. Computer Vision vol. 68, no. 3, pp. 239-266, 2006. [21] R. Hartley and S. Kang, "Parameter-Free Radial Distortion Correction with Centre of Distortion Estimation," Proc. IEEE Int'l Conf. Computer Vision, pp. 1834-1841, 2005. [22] R. Hartley and A. Zisserman, Multiple View Geometry in Computer Vision. Cambridge Univ. Press, 2003. [23] K. Josephson, M. Byröd, and K. Åström, "Pose Estimation with Radial Distortion and Unknown Focal Length," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2009. [24] S. Kang, "Catadioptric Self-Calibration," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2000. [25] S. Kang, "Radial Distortion Snakes," Proc. IAPR Workshop Machine Vision Applications, pp. 603-606, 2000. [26] K. Kuehnle and E. Mayr, "Exponential Space Computation of Groebner Bases," Proc. Int'l Symp. Symbolic and Algebraic Computation, 1996. [27] Z. Kukelova and T. Pajdla, "A Minimal Solution to the Autocalibration of Radial Distortion," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2007. [28] Z. Kukelova and T. Pajdla, "Two Minimal Problems for Cameras with Radial Distortion," Proc. Workshop Omnidirectional Vision, Camera Networks and Non-Classical Cameras, 2007. [29] Z. Kukelova, M. Bujnak, and T. Pajdla, "Polynomial Eigenvalue Solutions to the 5-Pt and 6-Pt Relative Pose Problems," Proc. British Machine Vision Conf., 2008. [30] Z. Kukelova, M. Bujnak, and T. Pajdla, "Automatic Generator of Minimal Problem Solvers," Proc. European Conf. Computer Vision, Oct. 2008. [31] Z. Kukelova, M. Byröd, K. Josephson, T. Pajdla, and K. Åström, "Fast and Robust Numerical Solutions to Minimal Problems for Cameras with Radial Distortion," Computer Vision and Image Understanding, vol. 114, no. 2, pp. 234-244, Feb. 2010. [32] H. Li, "A Simple Solution to the Six-Point Two-View Focal-Length Problem," Proc. European Conf. Computer Vision, pp. 200-213, 2006. [33] H. Li and R. Hartley, "A Non-Iterative Method for Correcting Lens Distortion from Nine-Point Correspondences," Proc. Workshop Omnidirectional Vision, Camera Networks and Non-Classical Cameras, 2005. [34] H. Li and R. Hartley, "Five-Point Motion Estimation Made Easy," Proc. Int'l Conf. Pattern Recognition, pp. 630-633, 2006. [35] J. Matas, O. Chum, M. Urban, and T. Pajdla, "Robust Wide-Baseline Stereo from Maximally Stable Extremal Regions," Image and Vision Computing, vol. 22, no. 10, pp. 761-767, 2004. [36] B. Micusik and T. Pajdla, "Structure from Motion with Wide Circular Field of View Cameras," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 28, no. 7, pp. 1135-1149, July 2006. [37] D. Nister, "An Efficient Solution to the Five-Point Relative Pose," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 26, no. 6, pp. 756-770, June 2004. [38] S. Ramalingam and P. Sturm, "Minimal Solutions for Generic Imaging Models," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2008. [39] Manual of Photogrammetry, C. Slama, ed., fourth ed. Am. Soc. of Photogrammetry, 1980. [40] R. Steele and C. Jaynes, "Overconstrained Linear Estimation of Radial Distortion and Multi-View Geometry," Proc. European Conf. Computer Vision, 2006. [41] G.P. Stein, "Accurate Internal Camera Calibration Using Rotation, with Analysis of Sources of Error," Proc. IEEE Int'l Conf. Computer Vision, 1995. [42] G. Stein, "Lens Distortion Calibration Using Point Correspondences," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 600-602, 1997. [43] H.J. Stetter, Numerical Polynomial Algebra. SIAM, 2004. [44] H. Stewenius, "Gröbner Basis Methods for Minimal Problems in Computer Vision," PhD thesis, Lund Univ., 2005. [45] H. Stewenius, C. Engels, and D. Nister, "Recent Developments on Direct Relative Orientation," ISPRS J. Photogrammetry and Remote Sensing, vol. 60, pp. 284-294, 2006. [46] H. Stewenius, D. Nister, F. Kahl, and F. Schaffalitzky, "A Minimal Solution for Relative Pose with Unknown Focal Length," Proc. IEEE CS Conf. Computer Vision and Pattern Recognition, pp. 789-794, 2005. [47] H. Stewenius, D. Nister, M. Oskarsson, and K. Astrom, "Solutions to Minimal Generalized Relative Pose Problems," Proc. Workshop Omnidirectional Vision, Camera Networks and Non-Classical Cameras, 2005. [48] R. Strand and E. Hayman, "Correcting Radial Distortion by Circle Fitting," Proc. British Machine Vision Conf., 2005. [49] J.P. Tardif, P. Sturm, and S. Roy, "Plane-Based Self-Calibration of Radial Distortion," Proc. 11th IEEE Int'l Conf. Computer Vision, Oct. 2007. [50] S. Thirthala and M. Pollefeys, "Multi-View Geometry of 1D Radial Cameras and Its Application to Omnidirectional Camera Calibration," Proc. IEEE Int'l Conf. Computer Vision, pp. 1539-1546, 2005. [51] S. Thirthala and M. Pollefeys, "The Radial Trifocal Tensor: A Tool for Calibrating the Radial Distortion of Wide-Angle Cameras," Proc. IEEE CS Conf. Computer Vision and Pattern Recognition, pp. 321-328, 2005. [52] P.H.S. Torr and D.W. Murray, "The Development and Comparison of Robust Methods for Estimating the Fundamental Matrix," Int'l J. Computer Vision, vol. 24, no. 3, pp. 271-300, 1997. [53] C. Traverso, "Gröbner Trace Algorithms," Proc. Int'l Symp. Symbolic and Algebraic Computation, pp. 125-138, 1988. [54] R. Tsai, "A Versatile Camera Calibration Technique for High-accuracy 3D Machine Vision Metrology using Off-the-Shelf TV Cameras and Lenses," IEEE J. Robotics and Automation, vol. 3, no. 4, pp. 323-344, Aug. 1987. [55] Z. Zhang, "On the Epipolar Geometry between Two Images with Lens Distortion," Proc. Int'l Conf. Pattern Recognition, 1996. [56] Z. Zhang, "A Flexible New Technique for Camera Calibration," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 22, no. 11, pp. 1330-1334, Nov. 2000.