This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Using Geometric Constraints through Parallelepipeds for Calibration and 3D Modeling
February 2005 (vol. 27 no. 2)
pp. 194-207
This paper concerns the incorporation of geometric information in camera calibration and 3D modeling. Using geometric constraints enables more stable results and allows us to perform tasks with fewer images. Our approach is motivated and developed within a framework of semi-automatic 3D modeling, where the user defines geometric primitives and constraints between them. It is based on the observation that constraints, such as coplanarity, parallelism, or orthogonality, are often embedded intuitively in parallelepipeds. Moreover, parallelepipeds are easy to delineate by a user and are well adapted to model the main structure of, e.g., architectural scenes. In this paper, first a duality that exists between the shape parameters of a parallelepiped and the intrinsic parameters of a camera is described. Then, a factorization-based algorithm exploiting this relation is developed. Using images of parallelepipeds, it allows us to simultaneously calibrate cameras, recover shapes of parallelepipeds, and estimate the relative pose of all entities. Besides geometric constraints expressed via parallelepipeds, our approach simultaneously takes into account the usual self-calibration constraints on cameras. The proposed algorithm is completed by a study of the singular cases of the calibration method. A complete method for the reconstruction of scene primitives that are not modeled by parallelepipeds is also briefly described. The proposed methods are validated by various experiments with real and simulated data, for single-view as well as multiview cases.

[1] O. Faugeras, “What Can Be Seen in Three Dimensions with an Uncalibrated Stereo Rig?” Proc. European Conf. Computer Vision, pp. 563-578, 1992.
[2] R. Tsai, “An Efficient and Accurate Camera Calibration Technique for 3D Machine Vision,” Proc. Conf. Computer Vision and Pattern Recognition, pp. 364-374, 1986.
[3] S. Maybank and O. Faugeras, “A Theory of Self Calibration of a Moving Camera,” Int'l J. Computer Vision, vol. 8, no. 2, pp. 123-151, 1992.
[4] B. Triggs, “Autocalibration and the Absolute Quadric,” Proc. Conf. Computer Vision and Pattern Recognition, pp. 609-614, 1997.
[5] R. Hartley, “Euclidean Reconstruction from Uncalibrated Views,” Proc. DARPA-ESPRIT Workshop Applications of Invariants in Computer Vision, pp. 187-202, 1993.
[6] M. Pollefeys and L. Van Gool, “A Stratified Approach to Metric Self-Calibration,” Proc. Conf. Computer Vision and Pattern Recognition, pp. 407-412, 1997.
[7] P. Sturm, “Critical Motion Sequences for Monocular Self-Calibration and Uncalibrated Euclidean Reconstruction,” Proc. Conf. Computer Vision and Pattern Recognition, pp. 1100-1105, 1997.
[8] R.I. Hartley, “Self-Calibration of Stationary Cameras,” Int'l J. Computer Vision, vol. 22, no. 1, pp. 5-23, 1997.
[9] L. de Agapito, R. Hartley, and E. Hayman, “Linear Self-Calibration of a Rotating and Zooming Camera,” Proc. Conf. Computer Vision and Pattern Recognition, pp. 15-21, 1999.
[10] M. Armstrong, A. Zisserman, and P. Beardsley, “Euclidean Structure from Uncalibrated Images,” Proc. British Machine Vision Conf., vol. 2, pp. 509-518, 1994.
[11] A. Zisserman, D. Liebowitz, and M. Armstrong, “Resolving Ambiguities in Auto-Calibration,” Philosophical Trans. Royal Soc. London, Series A, vol. 356, no. 1740, pp. 1193-1211, 1998.
[12] R. Hartley and A. Zisserman, Multiple View Geometry in Computer Vision. Cambridge Univ. Press, 2000.
[13] C. Tomasi and T. Kanade, “Shape and Motion from Image Streams under Orthography: A Factorization Method,” Int'l J. Computer Vision, vol. 9, no. 2, pp. 137-154, 1992.
[14] P. Sturm and B. Triggs, “A Factorization Based Algorithm for Multi-Image Projective Structure and Motion,” Proc. European Conf. Computer Vision, pp. 709-720, 1996.
[15] B. Triggs, “Factorization Methods for Projective Structure and Motion,” Proc. Conf. Computer Vision and Pattern Recognition, pp. 845-851, 1996.
[16] D. Martinec and T. Pajdla, “Structure from Many Perspective Images with Occlusions,” Proc. European Conf. Computer Vision, pp. 355-369, 2002.
[17] C. Rother, S. Carlsson, and D. Tell, “Projective Factorization of Planes and Cameras in Multiple Views,” Proc. Int'l Conf. Pattern Recognition, pp. 737-740, 2002.
[18] P. Sturm, “Algorithms for Plane-Based Pose Estimation,” Proc. Conf. Computer Vision and Pattern Recognition, pp. 1010-1017, 2000.
[19] B. Caprile and V. Torre, “Using Vanishing Points for Camera Calibration,” Int'l J. Computer Vision, vol. 4, pp. 127-140, 1990.
[20] R. Cipolla and E. Boyer, “3D Model Acquisition from Uncalibrated Images,” Proc. IAPR Workshop Computer Vision, pp. 559-568, 1998.
[21] C. Chen, C. Yu, and Y. Hung, “New Calibration-Free Approach for Augmented Reality Based on Parameterized Cuboid Structure,” Proc. Int'l Conf. Computer Vision, pp. 30-37, 1999.
[22] J. Kosecka and W. Zhang, “Video Compass,” Proc. European Conf. Computer Vision, pp. 476-491, 2002.
[23] D. Liebowitz and A. Zisserman, “Combining Scene and Auto-Calibration Constraints,” Proc. Int'l Conf. Computer Vision, pp. 293-300, 1999.
[24] D. Bondyfalat, T. Papadopoulo, and B. Mourrain, “Using Scene Constraints during the Calibration Procedure,” Proc. Int'l Conf. Computer Vision, pp. 124-130, 2001.
[25] P. Sturm and S. Maybank, “On Plane-Based Camera Calibration: A General Algorithm, Singularities, Applications,” Proc. Conf. Computer Vision and Pattern Recognition, pp. 432-437, 1999.
[26] Z. Zhang, “Flexible Camera Calibration by Viewing a Plane from Unknown Orientations,” Proc. Int'l Conf. Computer Vision, pp. 666-673, 1999.
[27] B. Triggs, “Autocalibration from Planar Scenes,” Proc. European Conf. Computer Vision, pp. 89-105, 1998.
[28] E. Malis and R. Cipolla, “Camera Self-Calibration from Unknown Planar Structures Enforcing the Multi-View Constraints between Collineations,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 24, no. 9, Sept. 2002.
[29] B. Boufama, R. Mohr, and F. Veillon, “Euclidean Constraints for Uncalibrated Reconstruction,” Proc. Int'l Conf. Computer Vision, pp. 466-470, 1993.
[30] A. Criminisi, I.D. Reid, and A. Zisserman, “Single View Metrology,” Int'l J. Computer Vision, vol. 40, no. 2, pp. 123-148, 2000.
[31] P. Sturm and S. Maybank, “A Method for Interactive 3D Reconstruction of Piecewise Planar Objects from Single Images,” Proc. British Machine Vision Conf., pp. 265-274, 1999.
[32] H.-Y. Shum, M. Han, and R. Szeliski, “Interactive Construction of 3D Models from Panoramic Mosaics,” Proc. Conf. Computer Vision and Pattern Recognition, pp. 427-433, 1998.
[33] E. Grossmann and J.S. Victor, “Single and Multi-View Reconstruction of Structured Scenes,” Proc. Asian Conf. Computer Vision, pp. 93-104, 2002.
[34] M. Wilczkowiak, P. Sturm, and E. Boyer, “The Analysis of Ambiguous Solutions in Linear Systems and Its Application to Computer Vision,” Proc. British Machine Vision Conf., pp. 53-62, 2003.
[35] C. McGlone, “Bundle Adjustment with Object Space Geometric Constraints for Site Modeling,” Proc. SPIE Conf. Integrating Photogrammetric Techniques with Scene Analysis and Machine Vision II, pp. 25-36, 1995.
[36] R. Szeliski and P. Torr, “Geometrically Constrained Structure from Motion: Points on Planes,” Proc. SMILE Workshop, pp. 171-186, 1998.
[37] P. McLauchlan, X. Shen, A. Manessis, P. Palmer, and A. Hilton, “Surface-Based Structure-from-Motion Using Feature Groupings,” Proc. Asian Conf. Computer Vision, pp. 699-705, 2000.
[38] E. Grossmann and J. Santos-Victor, “Dual Representations for Vision-Based 3D Reconstruction,” Proc. British Machine Vision Conf., pp. 516-526, 2000.
[39] D. Bondyfalat and S. Bougnoux, “Imposing Euclidean Constraints during Self-Calibration Processes,” Proc. SMILE Workshop, pp. 224-235, 1998.
[40] M. Wilczkowiak, G. Trombettoni, C. Jermann, P. Sturm, and E. Boyer, “Scene Modeling Based on Constraint System Decomposition Techniques,” Proc. Int'l Conf. Computer Vision, pp. 1004-1010, 2003.
[41] P. Debevec, C. Taylor, and J. Malik, “Modeling and Rendering Architecture from Photographs: A Hybrid Geometry and Image-Based Approach,” Proc. SIGGRAPH, pp. 11-20, 1996.
[42] D. Jelinek and C. Taylor, “Reconstruction of Linearly Parameterized Models from Single Images with a Camera of Unknown Focal Length,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 23, no. 7, pp. 767-774, July 2000.
[43] A. Dick, P. Torr, S. Ruffle, and R. Cipolla, “Combining Single View Recognition and Multiple View Stereo for Architectural Scenes,” Proc. Int'l Conf. Computer Vision, pp. 268-274, 2001.
[44] M. Wilczkowiak, E. Boyer, and P. Sturm, “Camera Calibration and 3D Reconstruction from Single Images Using Parallelepipeds,” Proc. Int'l Conf. Computer Vision, pp. 142-148, 2001.
[45] M. Wilczkowiak, E. Boyer, and P. Sturm, “3D Modelling Using Geometric Constraints: A Parallelepiped Based Approach,” Proc. European Conf. Computer Vision, pp. 221-236, 2002.
[46] M. Pollefeys, L. Van Gool, and M. Proesmans, “Euclidean 3D Reconstruction from Image Sequences with Variable Focal Lengths,” Proc. European Conf. Computer Vision, pp. 31-42, 1996.
[47] M. Wilczkowiak, P. Sturm, and E. Boyer, “Using Geometric Constraints through Parallelepipeds for Calibration and 3D Modelling,” INRIA, Rapport de Recherche 5055, 2003.
[48] T. Buchanan, “The Twisted Cubic and Camera Calibration,” Computer Vision, Graphics, and Image Processing, vol. 42, no. 1, pp. 130-132, 1988.
[49] F. Kahl, B. Triggs, and K. Åström, “Critical Motions for Auto-Calibration when Some Intrinsic Parameters Can Vary,” J. Math. Imaging and Vision, vol. 13, no. 2, pp. 131-146, 2000.
[50] D. Liebowitz and A. Zisserman, “Metric Rectification for Perspective Images of Planes,” Proc. Conf. Computer Vision and Pattern Recognition, pp. 482-488, 1998.

Index Terms:
3D modeling, calibration, geometric constraints.
Citation:
Marta Wilczkowiak, Peter Sturm, Edmond Boyer, "Using Geometric Constraints through Parallelepipeds for Calibration and 3D Modeling," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 27, no. 2, pp. 194-207, Feb. 2005, doi:10.1109/TPAMI.2005.40
Usage of this product signifies your acceptance of the Terms of Use.