Subscribe
Issue No.05 - May (2013 vol.35)
pp: 1206-1220
Xianghua Ying , Key Lab. of Machine Perception (Minist. of Educ.), Peking Univ., Beijing, China
Kun Peng , Dept. of Comput. Sci., Univ. of North Carolina, Chapel Hill, NC, USA
Yongbo Hou , Key Lab. of Machine Perception (Minist. of Educ.), Peking Univ., Beijing, China
Sheng Guan , Key Lab. of Machine Perception (Minist. of Educ.), Peking Univ., Beijing, China
Jing Kong , Key Lab. of Machine Perception (Minist. of Educ.), Peking Univ., Beijing, China
Hongbin Zha , Key Lab. of Machine Perception (Minist. of Educ.), Peking Univ., Beijing, China
ABSTRACT
If an object is interreflected between two planar mirrors, we may take an image containing both the object and its multiple reflections, i.e., simultaneously imaging multiple views of an object by a single pinhole camera. This paper emphasizes the problem of recovering both the intrinsic and extrinsic parameters of the camera using multiple silhouettes from one single image. View pairs among views in a single image can be divided into two kinds by the relationship between the two views in the pair: reflected by some mirror (real or virtual) and in a circular motion. Epipoles in the first kind of pairs can be easily determined from intersections of common tangent lines of silhouettes. Based on the projective properties of these epipoles, efficient methods are proposed to recover both the imaged circular points and the included angle between two mirrors. Epipoles in the second kind of pairs can be recovered simultaneously with the projection of intersection line between two mirrors by solving a simple 1D optimization problem using the consistency constraint of epipolar tangent lines. Fundamental matrices among views in a single image are all recovered. Using the estimated intrinsic and extrinsic parameters of the camera, a euclidean reconstruction can be obtained. Experiments validate the proposed approach.
INDEX TERMS
Cameras, Mirrors, Reflection, Vectors, Calibration, Transmission line matrix methods, Geometry, planar mirrors, Self-calibration, circular points, silhouettes, catadioptric camera
CITATION
Xianghua Ying, Kun Peng, Yongbo Hou, Sheng Guan, Jing Kong, Hongbin Zha, "Self-Calibration of Catadioptric Camera with Two Planar Mirrors from Silhouettes", IEEE Transactions on Pattern Analysis & Machine Intelligence, vol.35, no. 5, pp. 1206-1220, May 2013, doi:10.1109/TPAMI.2012.195
REFERENCES
 [1] K. Aström, R. Cipolla, and P. Giblin, "Generalised Epipolar Constraints," Int'l J. Computer Vision, vol. 33, no. 1, pp. 51-72, Sept. 1999. [2] B. Caprile and V. Torre, "Using Vanishing Points for Camera Calibration," Int'l J. Computer Vision, vol. 4, no. 2, pp. 127-139, Mar. 1990. [3] R. Cipolla, K.E. Aström, and P.J. Giblin, "Motion from the Frontier of Curved Surfaces," Proc. Fifth IEEE Int'l Conf. Computer Vision, pp. 269-275, June 1995. [4] A.W. Fitzgibbon, G. Cross, and A. Zisserman, "Automatic 3D Model Construction for Turn-Table Sequences," Proc. European Workshop 3D Structure from Multiple Images of Large-Scale Environments, pp. 721-731, 1998. [5] K. Forbes, F. Nicolls, G.D. Jager, and A. Voigt, "Shape-from-Silhouette with Two Mirrors and an Uncalibrated Camera," Proc. European Conf. Computer Vision, vol. 2, pp. 165-178, 2006. [6] S. Fujiyama, F. Sakaue, and J. Sato, "Multiple View Geometries for Mirrors and Cameras," Proc. Int'l Conf. Pattern Recognition, pp. 45-48, Aug. 2010. [7] J. Gluckman and S.K. Nayar, "Rectified Catadioptric Stereo Sensors," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 24, no. 2, pp. 224-236, Feb. 2002. [8] P. Gurdjos, P. Sturm, and Y. Wu, "Euclidean Structure from $N \ge 2$ Parallel Circles: Theory and Algorithms," Proc. European Conf. Computer Vision, pp. 238-252, 2006. [9] R. Hartley and A. Zisserman, Multiple View Geometry in Computer Vision. Cambridge Univ. Press, 2003. [10] E. Hecht and A. Zajac, Optics, third ed. Addison-Wesley, 1997. [11] C. Hernández, F. Schmitt, and R. Cipolla, "Silhouette Coherence for Camera Calibration under Circular Motion," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 29, no. 2, pp. 343-349, Feb. 2007. [12] P.-H. Huang and S.-H. Lai, "Contour-Based Structure from Reflection," Proc. IEEE Conf. Computer Vision and Pattern Recognition, vol. 1, pp. 379-386, 2006. [13] P.-H. Huang and S.-H. Lai, "Silhouette-Based Camera Calibration from Sparse Views Under Circular Motion," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 24-26, 2008. [14] G. Jiang, L. Quan, and H.T. Tsui, "Circular Motion Geometry Using Minimal Data," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 26, no. 6, pp. 721-731, June 2004. [15] G. Jiang, H.T. Tsui, L. Quan, and A. Zisserman, "Single Axis Geometry by Fitting Conics," Proc. European Conf. Computer Vision, pp. 537-550, 2002. [16] T. Joshi, N. Ahuja, and J. Ponce, "Structure and Motion Estimation from Dynamic Silhouettes under Perspective Projection," Int'l J. Computer Vision, vol. 31, no. 1, pp. 31-50, June 1999. [17] J.S. Kim, P. Gurdjos, and I.S. Kweon, "Geometric and Algebraic Constraints of Projected Concentric Circles and Their Applications to Camera Calibration," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 27, no. 4, pp. 637-642, Apr. 2005. [18] R.K. Kumar, A. Ilie, J. Michael Frahm, and M. Pollefeys, "Simple Calibration of Non-Overlapping Cameras with a Mirror," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 1-7, 2008. [19] D. Lanman, D.E. Crispell, and G. Taubin, "Surround Structured Lighting: 3-D Scanning with Orthographic Illumination," Computer Vision and Image Understanding, vol. 113, no. 11, pp. 1107-1117, Nov. 2009. [20] G.L. Mariottini, S. Scheggi, F. Morbidi, and D. Prattichizzo, "Planar Catadioptric Stereo: Single and Multi-View Geometry for Calibration and Localization," Proc. Int'l Conf. Robotics and Automation, pp. 1510-1515, 2009. [21] P.R.S. Mendonca, K.-Y.K. Wong, and R. Cipolla, "Epipolar Geometry from Profiles under Circular Motion," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 23, no. 6, pp. 604-616, June 2001. [22] H. Mitsumoto, S. Tamura, K. Okazaki, N. Kajimi, and Y. Fukui, "3-D Reconstruction Using Mirror Images Based on a Plane Symmetry Recovering Method," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 14, no. 9, pp. 941-946, Sept. 1992. [23] J. Porrill and S. Pollard, "Curve Matching and Stereo Calibration," Image and Vision Computing, vol. 9, no. 1, pp. 45-50, Feb. 1991. [24] J.H. Rieger, "3D Motion from Fixed Points of a Deforming Profile Curve," Optics Letters, vol. 11, no. 3, pp. 123-125, Mar. 1986. [25] R. Rodrigues, J.P. Barreto, and U. Nunes, "Camera Pose Estimation Using Images of Planar Mirror Reflections," Proc. European Conf. Computer Vision, pp. 382-395, 2010. [26] J. Semple and G. Kneebone, Algebraic Projective Geometry. Oxford Classic Series, 1952. [27] S.N. Sinha, M. Pollefeys, and L. Mcmillan, "Camera Network Calibration from Dynamic Silhouettes," Proc. IEEE Conf. Computer Vision and Pattern Recognition, vol. 1, pp. 195-202, 2004. [28] P.F. Sturm and T. Bonfort, "How to Compute the Pose of an Object without a Direct View?" Proc. Asian Conf. Computer Vision, pp. 21-31, 2006. [29] K. Tan, H. Hua, and N. Ahuja, "Multiview Panoramic Cameras Using Mirror Pyramids," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 26, no. 6, pp. 941-946, June 2004. [30] T. Vieville and D. Lingrand, "Using Singular Displacements for Uncalibrated Monocular Visual Systems," Proc. Fourth European Conf. Computer Vision, pp. 207-216, Apr. 1996. [31] K.-Y. K. Wong, G. Zhang, C. Liang, and H. Zhang, "1D Camera Geometry and Its Application to the Self-Calibration of Circular Motion Sequences," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 30, no. 12, pp. 2243-2248, Dec. 2008. [32] K.-Y.K. Wong and R. Cipolla, "Reconstruction of Sculpture from Its Profiles with Unknown Camera Positions," IEEE Trans. Image Processing, vol. 13, no. 3, pp. 381-389, Mar. 2004. [33] H.H.P. Wu, "Rectification of Stereoscopic Video for Planar Catadioptric Stereo Systems," IEEE Trans. Circuits and Systems for Video Technology, vol. 17, no. 6, pp. 686-698, June 2007. [34] X. Ying, K. Peng, R. Ren, and H. Zha, "Geometric Properties of Multiple Reflections in Catadioptric Camera with Two Planar Mirrors," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 1126-1132, 2010. [35] H. Zhang and K.-Y.K. Wong, "Self-Calibration of Turntable Sequences from Silhouettes," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 31, no. 1, pp. 5-14, Jan. 2009. [36] Z. Zhang, "Flexible Camera Calibration by Viewing a Plane from Unknown Orientations," Proc. Seventh IEEE Int'l Conf. Computer Vision, pp. 666-673, 1999. [37] H. Zhong, W.F. Sze, and Y.S. Hung, "Reconstruction from Plane Mirror Reflection," Proc. Int'l Conf. Pattern Recognition, vol. 1, pp. 715-718, 2006.