The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.11 - Nov. (2012 vol.34)
pp: 2097-2107
F. Vasconcelos , Dept. of Electr. & Comput. Eng., Univ. of Coimbra, Coimbra, Portugal
J. P. Barreto , Dept. of Electr. & Comput. Eng., Univ. of Coimbra, Coimbra, Portugal
U. Nunes , Dept. of Electr. & Comput. Eng., Univ. of Coimbra, Coimbra, Portugal
ABSTRACT
This paper presents a new algorithm for the extrinsic calibration of a perspective camera and an invisible 2D laser-rangefinder (LRF). The calibration is achieved by freely moving a checkerboard pattern in order to obtain plane poses in camera coordinates and depth readings in the LRF reference frame. The problem of estimating the rigid displacement between the two sensors is formulated as one of registering a set of planes and lines in the 3D space. It is proven for the first time that the alignment of three plane-line correspondences has at most eight solutions that can be determined by solving a standard p3p problem and a linear system of equations. This leads to a minimal closed-form solution for the extrinsic calibration that can be used as hypothesis generator in a RANSAC paradigm. Our calibration approach is validated through simulation and real experiments that show the superiority with respect to the current state-of-the-art method requiring a minimum of five input planes.
INDEX TERMS
Calibration, Cameras, Equations, Lasers, Three dimensional displays, Vectors, Sensors, sensor fusion, Extrinsic calibration, laser-rangefinder, euclidean registration, minimal problems
CITATION
F. Vasconcelos, J. P. Barreto, U. Nunes, "A Minimal Solution for the Extrinsic Calibration of a Camera and a Laser-Rangefinder", IEEE Transactions on Pattern Analysis & Machine Intelligence, vol.34, no. 11, pp. 2097-2107, Nov. 2012, doi:10.1109/TPAMI.2012.18
REFERENCES
[1] C. Früh and A. Zakhor, "An Automated Method for Large-Scale, Ground-Based City Model Acquisition," Int'l J. Computer Vision, vol. 60, pp. 5-24, 2004.
[2] B. Douillard, D. Fox, and F. Ramos, "Laser and Vision Based Outdoor Object Mapping," Proc. Robotics: Science and Systems Conf., 2008.
[3] C. Premebida, O. Ludwig, and U. Nunes, "Lidar and Vision-Based Pedestrian Detection System," J. Field Robotics, vol. 26, pp. 696-711, Sept. 2009.
[4] F.T. Ramos, J. Nieto, and H.F. Durrant-Whyte, "Recognising and Modelling Landmarks to Close Loops in Outdoor Slam," Proc. IEEE Int'l Conf. Robotics and Automation, pp. 2036-2041, 2007.
[5] Q. Zhang and R. Pless, "Extrinsic Calibration of a Camera and Laser Range Finder (Improves Camera Calibration)," Proc. IEEE/RSJ Int'l Conf. Intelligent Robots and Systems, vol. 3, pp. 2301-2306, 2004.
[6] Y. Ma, An Invitation to 3-D Vision: From Images to Geometric Models. Springer, 2004.
[7] B. Triggs, P. McLauchlan, R. Hartley, and A. Fitzgibbon, "Bundle Adjustment—A Modern Synthesis," Proc. Int'l Workshop Vision Algorithms: Theory and Practice, pp. 153-177, 1883.
[8] T. Moriya and H. Takeda, "Solving the Rotation-Estimation Problem by Using the Perspective Three-Point Algorithm," Proc. IEEE Conf. Computer Vision and Pattern Recognition, vol. 1, pp. 766-773, 2000.
[9] R.M. Haralick, C.-N. Lee, K. Ottenberg, and M. Nölle, "Review and Analysis of Solutions of the Three Point Perspective Pose Estimation Problem," Int'l J. Computer Vision, vol. 13, pp. 331-356, Dec. 1994.
[10] M.A. Fischler and R.C. Bolles, "Random Sample Consensus—A Paradigm for Model-Fitting with Applications to Image-Analysis and Automated Cartography," Comm. ACM, vol. 24, no. 6, pp. 381-395, 1981.
[11] Z. Zhang, "Flexible Camera Calibration by Viewing a Plane from Unknown Orientations," Proc. IEEE Int'l Conf. Computer Vision, vol. 1, pp. 666-673, 1999.
[12] J.P. Barreto, J. Roquette, P. Sturm, and F. Fonseca, "Automatic Camera Calibration Applied to Medical Endoscopy," Proc. British Machine Vision Conf., 2009.
[13] R. Unnikrishnan and M. Hebert, "Fast Extrinsic Calibration of a Laser Rangefinder to a Camera," technical report, 2005.
[14] D. Scaramuzza and A. Harati, "Extrinsic Self Calibration of a Camera and a 3D Laser Range Finder from Natural Scenes," Proc. IEEE Int'l Conf. Intelligent Robots and Systems, 2007.
[15] C. Gao and J.R. Spletzer, "On-Line Calibration of Multiple Lidars on a Mobile Vehicle Platform," Proc. IEEE Int'l Conf. Robotics and Automation, pp. 279-284, 2010.
[16] G. Li, Y. Liu, L. Dong, X. Cai, and D. Zhou, "An Algorithm for Extrinsic Parameters Calibration of a Camera and a Laser Range Finder Using Line Features," Proc. IEEE/RSJ Int'l Conf. Intelligent Robots and Systems, pp. 3854-3859, Nov. 2007.
[17] P. Nez, P. DrewsJr, R. Rocha, and J. Dias, "Data Fusion Calibration for a 3D Laser Range Finder and a Camera Using Inertial Data," Proc. European Conf. Mobile Robots, p. 3136, 2009.
[18] H. Aliakbarpour, P. Nuez, J. Prado, K. Khoshhal, and J. Dias, "An Efficient Algorithm for Extrinsic Calibration between a 3D Laser Range Finder and a Stereo Camera for Surveillance," Proc. Int'l Conf. Advanced Robotics, pp. 1-6, June 2009.
[19] O. Naroditsky, A. Patterson, and K. Daniilidis, "Automatic Alignment of a Camera with a Line Scan Lidar System," Proc. IEEE Int'l Conf. Robotics and Automation, 2011.
[20] V. Caglioti, A. Giusti, and D. Migliore, "Mutual Calibration of a Camera and a Laser Rangefinder," Proc. Int'l Conf. Computer Vision Theory and Applications, pp. 33-42, 2008.
[21] B.K.P. Horn, H.M. Hilden, and S. Negahdaripour, "Closed-Form Solution of Absolute Orientation Using Orthonormal Matrices," J. Optical Soc. Am. A, vol. 5, no. 7, pp. 1127-1135, July 1988.
[22] V. Lepetit, F. Moreno-Noguer, and P. Fua, "EPNP: An Accurate O(n) Solution to the PNP Problem," Int'l J. Computer Vision, vol. 81, pp. 155-166, Feb. 2009.
[23] C. Olsson, F. Kahl, and M. Oskarsson, "Branch-and-Bound Methods for Euclidean Registration Problems," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 31, no. 5, pp. 783-794, May 2009.
[24] S. Ramalingam, Y. Taguchi, T.K. Marks, and O. Tuzel, "P2pi: A Minimal Solution for Registration of 3D Points to 3D Planes," Proc. European Conf. Computer Vision, pp. 436-449, 2010.
[25] J. Stolfi, Oriented Projective Geometry: A Framework for Geometric Computations. Academic Press, 1991.
[26] J. Grunert, "Das Pothenotiscfie Problem in Erweiterter Gestalt Nebst ber Seine Anwendungen in der Geodsie," Grunerts Archiv für Mathematik und Physik, vol. 1, pp. 238-248, 1841.
[27] P.F. Sturm and J.P. Barreto, "General Imaging Geometry for Central Catadioptric Cameras," Proc. European Conf. Computer Vision, pp. 609-622, 2008.
[28] J. Barreto, J. Santos, P. Menezes, and F. Fonseca, "Ray-Based Calibration of Rigid Medical Endoscopes," Proc. Eighth Workshop Omnidirectional Vision, Camera Networks and Non-Classical Cameras, 2008.
[29] P.H.S. Torr and A. Zisserman, "MLESAC: A New Robust Estimator with Application to Estimating Image Geometry," Computer Vision and Image Understanding, vol. 78, pp. 138-156, Apr. 2000.
[30] SICK AG, LMS200/211/221/291 Laser Measurement Systems.
30 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool