| | This Article | |
| |
| |
| | Share | |
| |
| |
| | Bibliographic References | |
| |
| |
| | Add to: | |
| |
 Digg
 Furl
 Spurl
 Blink
 Simpy
 Google
 Del.icio.us
 Y!MyWeb
| |
| | Search | |
| |
| |
| | |
Robust Recovery of Shapes with Unknown Topology from the Dual Space
December 2007 (vol. 29 no. 12)
pp. 2205-2216
In this paper, we address the problem of reconstructing an object surface from silhouettes. Previous works by other authors have shown that, based on the principle of duality, surface points can be recovered, theoretically, as the dual to the tangent plane space of the object. In practice, however, the identification of tangent basis in the tangent plane space is not trivial given a set of discretely sampled data. This problem is further complicated by the existence of bi-tangents to the object surface. The key contribution of this paper is the introduction of epipolar parameterization in identifying a well-defined local tangent basis. This extends the applicability of existing dual space reconstruction methods to fairly complicated shapes, without making any explicit assumption on the object topology. We verify our approach with both synthetic and real-world data, and compare it both qualitatively and quantitatively with other popular reconstruction algorithms. Experimental results demonstrate that our proposed approach produces more accurate estimation, whilst maintaining reasonable robustness towards shapes with complex topologies.
[1] K. Kang, J.-P. Tarel, R. Fishman, and D. Cooper, “A Linear Dual-Space Approach to 3D Surface Reconstruction from Occluding Contours Using Algebraic Surface,” Proc. Int'l Conf. Computer Vision, vol. 1, pp. 198-204, July 2001.
[2] M. Brand, K. Kang, and D. Cooper, “An Algebraic Solution to Visual Hull,” Computer Vision and Pattern Recognition, vol. 1, pp.30-35, July 2004.
[3] W. Martin and J. Aggarwal, “Volumetric Descriptions of Objects from Multiple Views,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 5, no. 2, pp. 150-158, 1983.
[4] C. Chien and J. Aggarwal, “Volume/Surface Octrees for the Representation of Three-Dimensional Objects,” Computer Vision, Graphics, and Image Processing, vol. 36, no. 1, pp. 100-113, Oct. 1986.
[5] M. Potmesil, “Generating Octree Models of 3D Objects from Their Silhouettes in a Sequence of Images,” Computer Vision, Graphics, and Image Processing, vol. 40, no. 1, pp. 1-29, Oct. 1987.
[6] R. Szeliski, “Rapid Octree Construction from Image Sequences,” CVGIP: Image Understanding, vol. 58, no. 1, pp. 23-32, July 1993.
[7] B. García and B. Brunet, “3D Reconstruction with Projective Octrees and Epipolar Geometry,” Proc. Int'l Conf. Computer Vision, pp. 1067-1072, Jan. 1998.
[8] K.-Y. Wong, “Structure and Motion from Silhouettes,” PhD dissertation, Univ. of Cambridge, 2001.
[9] A. Laurentini, “The Visual Hull Concept for Silhouette-Based Image Understanding,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 16, no. 2, pp. 150-162, Feb. 1994.
[10] B. Baumgart, “A Polyhedron Representation for Computer Vision,” Proc. AFIPS Nat'l Computer Conf., 1975.
[11] S. Sullivan and J. Ponce, “Automatic Model Construction and Pose Estimation from Photographs Using Triangular Splines,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 20, no. 10, pp.1091-1096, Oct. 1998.
[12] S. Lazebnik, E. Boyer, and J. Ponce, “On Computing Exact Visual Hulls of Solids Bounded by Smooth Surfaces,” Computer Vision and Pattern Recognition, vol. 1, pp. 156-161, Dec. 2001.
[13] S. Lazebnik, “Projective Visual Hulls,” master's thesis, Univ. of Illinois at Urbana-Champaign, 2002.
[14] W. Matusik, C. Buehler, and L. McMillan, “Polyhedral Visual Hulls for Real-Time Rendering,” Proc. Eurographics Workshop Rendering, 2001.
[15] E. Boyer and J.-S. Franco, “A Hybrid Approach for Computing Visual Hulls of Complex Objects,” Computer Vision and Pattern Recognition, vol. 1, pp. 695-701, June 2003.
[16] J.-S. Franco and E. Boyer, “Exact Polyhedral Visual Hulls,” Proc. British Machine Vision Conf., vol. 1, pp. 329-338, Sept. 2003.
[17] G. Cheung, S. Baker, and T. Kanade, “Visual Hull Alignment and Refinement Across Time: A 3D Reconstruction Algorithm Combining Shape-from-Silhouette with Stereo,” Computer Vision and Pattern Recognition, June 2003.
[18] R. Cipolla and A. Blake, “Surface Shape from the Deformation of Apparent Contours,” Int'l J. Computer Vision, vol. 9, no. 2, pp. 83-112, 1992.
[19] R. Vaillant and O. Faugeras, “Using Extremal Boundaries for 3D Object Modeling,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 14, no. 2, pp. 157-173, Feb. 1992.
[20] E. Boyer and M.-O. Berger, “3D Surface Reconstruction Using Occluding Contours,” Computer Analysis of Images and Patterns, pp.198-205, 1995.
[21] P. Giblin and R. Weiss, “Reconstruction of Surfaces from Profiles,” Proc. Int'l Conf. Computer Vision, pp. 136-144, June 1987.
[22] K.N. Kutulakos, “Shape from the Light Field Boundary,” Computer Vision and Pattern Recognition, pp. 53-59, June 1997.
[23] K. Kang, “Three-Dimensional Free Form Surface Reconstruction from Occluding Contours in a Sequence Images or Video,” PhD dissertation, LEMS, Division of Eng., Brown Univ., 2004.
[24] A. Sethi, D. Renaudie, D. Kriegman, and J. Ponce, “Curve and Surface Duals and the Recognition of Curved 3D Objects from Their Silhouette,” Int'l J. Computer Vision, vol. 58, no. 1, pp. 73-86, 2004.
[25] R. Cipolla and P. Giblin, Visual Motion of Curves and Surfaces. Cambridge Univ. Press, 2000.
[26] Y. Ohta and T. Kanade, “Stereo by Intra- and Inter-Scanline Search Using Dynamic Programming,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 7, pp. 139-154, 1985.
[27] R. Weiss, “The Epipolar Parameterization,” Proc. Int'l NSF-ARPA Workshop Object Representation in Computer Vision, pp. 101-107, Dec. 1994.
[28] R. Cipolla, G. Fletcher, and P. Giblin, “Following Cusps,” Int'l J. Computer Vision, vol. 23, no. 2, pp. 115-129, 1997.
[29] R. Cipolla, K. Åström, and P. Giblin, “Motion from the Frontier of Curved Surfaces,” Proc. Int'l Conf. Computer Vision, pp. 269-275, June 1995.
[30] K.-Y. Wong and R. Cipolla, “Structure and Motion from Silhouettes,” Int'l Conf. Computer Vision, vol. 2, pp. 217-222, 2001.
[31] E. Boyer and M.-O. Berger, “3D Surface Reconstruction Using Occluding Contours,” Int'l J. Computer Vision, vol. 22, pp. 219-233, 1997.
[32] J.-D. Boissonnat, “Shape Reconstruction from Planar Cross Sections,” Computer Vision, Graphics, and Image Processing, vol. 44, no. 1, pp. 1-29, Oct. 1988.
Index Terms:
Reconstruction, duality principle, tangent envelope, epipolar parameterization, surface extraction
Citation:
Chen Liang, Kwan-Yee K. Wong, "Robust Recovery of Shapes with Unknown Topology from the Dual Space," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 29, no. 12, pp. 2205-2216, June 2007, doi:10.1109/TPAMI.2007.1127
