This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Robust Structure and Motion from Outlines of Smooth Curved Surfaces
February 2006 (vol. 28 no. 2)
pp. 302-315
This paper addresses the problem of estimating the motion of a camera as it observes the outline (or apparent contour) of a solid bounded by a smooth surface in successive image frames. In this context, the surface points that project onto the outline of an object depend on the viewpoint and the only true correspondences between two outlines of the same object are the projections of frontier points where the viewing rays intersect in the tangent plane of the surface. In turn, the epipolar geometry is easily estimated once these correspondences have been identified. Given the apparent contours detected in an image sequence, a robust procedure based on RANSAC and a voting strategy is proposed to simultaneously estimate the camera configurations and a consistent set of frontier point projections by enforcing the redundancy of multiview epipolar geometry. The proposed approach is, in principle, applicable to orthographic, weak-perspective, and affine projection models. Experiments with nine real image sequences are presented for the orthographic projection case, including a quantitative comparison with the ground-truth data for the six data sets for which the latter information is available. Sample visual hulls have been computed from all image sequences for qualitative evaluation.

[1] S. Birchfield, “KLT: An Implementation of the Kanade-Lucas-Tomasi Feature Tracker,” http://vision.stanford.edu/birchklt/, 1998.
[2] C. Tomasi and T. Kanade, “Shape and Motion from Image Streams under Orthography: A Factorization Method,” Int'l J. Computer Vision, vol. 9, no. 2, pp. 137-154, 1992.
[3] O. Faugeras, Q.-T. Luong, and T. Papadopoulo, The Geometry of Multiple Images. MIT Press, 2001.
[4] D. Forsyth and J. Ponce, Computer Vision: A Modern Approach. Prentice-Hall, 2002.
[5] R. Hartley and A. Zisserman, Multiple View Geometry in Computer Vision. Cambridge Univ. Press, 2000.
[6] P. Torr and D. Murray, “The Development and Comparison of Robust Methods for Estimating the Fundamental Matrix,” Int'l J. Computer Vision, vol. 24, no. 3, pp. 271-300, 1997.
[7] M.A. Fischler and R.C. Bolles, “Random Sample Consensus: A Paradigm for Model Fitting with Applications to Image Analysis and Automated Cartography,” Comm. ACM, vol. 24, no. 6, pp. 381-395, 1981.
[8] P. Torr, A. Zisserman, and S. Maybank, “Robust Detection of Degenerate Configurations for the Fundamental Matrix,” Proc. Int'l Conf. Computer Vision, pp. 1037-1042, 1995.
[9] P. Torr and A. Zisserman, “MLESAC: A New Robust Estimator with Application to Estimating Image Geometry,” Computer Vision and Image Understanding, vol. 78, no. 1, pp. 138-156, 2000.
[10] P. Giblin and R. Weiss, “Epipolar Curves on Surfaces,” Image and Vision Computing, vol. 13, no. 1, pp. 33-44, 1995.
[11] A. Sethi, D. Renaudie, D. Kriegman, and J. Ponce, “Curve and Surface Duals and the Recognition of Curved 3D Objects from Their Silhouette,” Int'l J. Computer Vision, vol. 58, no. 1, pp. 73-86, 2004.
[12] N. Levi and M. Werman, “The Viewing Graph,” Proc. IEEE Int'l Conf. Computer Vision and Pattern Recognition, pp. 518-522, 2003.
[13] B. Baumgart, “Geometric Modeling for Computer Vision,” PhD dissertation, Stanford Univ., 1974.
[14] A. Laurentini, “How Far 3D Shapes Can Be Understood from 2D Silhouettes,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 17, no. 2, pp. 188-194, Feb. 1995.
[15] S. Lazebnik, E. Boyer, and J. Ponce, “On Computing Exact Visual Hulls of Solids Bounded by Smooth Surfaces,” Proc. IEEE Int'l Conf. Computer Vision and Pattern Recognition, pp. 156-161, 2001.
[16] Y. Furukawa, A. Sethi, J. Ponce, and D.J. Kriegman, “Structure and Motion from Images of Smooth Textureless Objects,” Proc. European Conf. Computer Vision, pp. 287-298, 2004.
[17] P. Giblin and R. Weiss, “Reconstruction of Surface from Profiles,” Proc. Int'l Conf. Computer Vision, pp. 136-144, 1987.
[18] E. Boyer and M.O. Berger, “3D Surface Reconstruction Using Occluding Contours,” Int'l J. Computer Vision, vol. 22, no. 3, pp. 219-233, 1997.
[19] R. Cipolla and A. Blake, “Surface Shape from the Deformation of Apparent Contours,” Int'l J. Computer Vision, vol. 9, no. 2, pp. 83-112, 1992.
[20] R. Szeliski and R. Weiss, “Robust Shape Recovery from Occluding Contours Using a Linear Smoother,” Int'l J. Computer Vision, vol. 28, no. 1, pp. 27-44, 1998.
[21] N. Ahuja and J. Veenstra, “Generating Octrees from Object Silhouettes in Orthographic Views,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 11, no. 2, pp. 137-149, Feb. 1989.
[22] C. Connolly and J. Stenstrom, “3D Scene Reconstruction from Multiple Intensity Images,” Proc. IEEE Workshop Interpretation of 3D Scenes, Nov. pp. 124-130, 1989.
[23] W. Matusik, C. Buehler, R. Raskar, S. Gortler, and L. McMillan, “Image-Based Visual Hulls,” Proc. SIGGRAPH, 2001.
[24] S. Sullivan and J. Ponce, “Automatic Model Construction, Pose Estimation, and Object Recognition from Photographs Using Triangular Splines,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 20, no. 10, pp. 1091-1096, Oct. 1998.
[25] S. Lazebnik, “Projective Visual Hulls,” technical report, MS thesis, Univ. of Illinois at Urbana-Champaign, 2002.
[26] R. Vaillant and O.D. Faugeras, “Using Extremal Boundaries for 3D Object Modeling,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 14, no. 2, pp. 157-173, Feb. 1992.
[27] T. Joshi, N. Ahuja, and J. Ponce, “Structure and Motion Estimation from Dynamic Silhouettes under Perspective Projection,” Proc. Int'l Conf. Computer Vision, pp. 290-295, 1995.
[28] P. Giblin, F.E. Pollick, and J.E. Rycroft, “Recovery of an Unknown Axis of Rotation from the Profiles of a Rotating Surface,” J. Optical Soc. Am., pp. 1976-1984, 1994.
[29] P. Mendonca, K.-Y.K. Wong, and R. Cipolla, “Camera Pose Estimation and Reconstruction from Image Profiles under Circular Motion,” Proc. European Conf. Computer Vision, pp. 864-877, 2000.
[30] K.-Y.K. Wong and R. Cipolla, “Structure and Motion from Silhouettes,” Proc. Int'l Conf. Computer Vision, pp. 217-222, 2001.
[31] R. Cipolla, K.E. Åström, and P.J. Giblin, “Motion from the Frontier of Curved Surfaces,” Proc. Int'l Conf. Computer Vision, pp. 269-275, 1995.
[32] K. Åström and F. Kahl, “Motion Estimation in Image Sequences Using the Deformation of Apparent Contours,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 21, no. 2, pp. 114-127, Feb. 1999.
[33] A.J. Yezzi and S. Soatto, “Structure from Motion for Scenes without Features,” Proc. IEEE Int'l Conf. Computer Vision and Pattern Recognition, pp. I: 525-532, 2003.
[34] B. Vijayakumar, D.J. Kriegman, and J. Ponce, “Structure and Motion of Curved 3D Objects from Monocular Silhouettes,” Proc. IEEE Int'l Conf. Computer Vision and Pattern Recognition, pp. 327-334, 1996.
[35] J. Koenderink, “What Does the Occluding Contour Tell Us About Solid Shape?” Perception, vol. 13, pp. 321-330, 1984.
[36] O. Faugeras, “Stratification of 3D Vision: Projective, Affine and Metric Representations,” J. Optical Soc. Am. A, vol. 12, no. 3, pp. 465-484, Mar. 1995.
[37] J. Koenderink and A. Van Doorn, “Affine Structure from Motion,” J. Optical Soc. Am. A, vol. 8, pp. 377-385, 1990.
[38] C. Poelman and T. Kanade, “A Paraperspective Factorization Method for Shape and Motion Recovery,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 19, no. 3, pp. 206-218, Mar. 1997.
[39] Y. Wang, E.K. Teoh, and D. Shen, “Structure-Adaptive B-Snake for Segmenting Complex Objects,” Proc. IEEE Int'l Conf. Image Processing, 2001.

Index Terms:
Index Terms- Image processing and computer vision, motion, shape.
Citation:
Yasutaka Furukawa, Amit Sethi, Jean Ponce, David J. Kriegman, "Robust Structure and Motion from Outlines of Smooth Curved Surfaces," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 28, no. 2, pp. 302-315, Feb. 2006, doi:10.1109/TPAMI.2006.41
Usage of this product signifies your acceptance of the Terms of Use.