This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Inference-Based Surface Reconstruction of Cluttered Environments
Aug. 2012 (vol. 18 no. 8)
pp. 1255-1267
K. Biggers, Dept. of Comput. Sci. & Eng., Texas A&M Univ., College Station, TX, USA
J. Keyser, Dept. of Comput. Sci. & Eng., Texas A&M Univ., College Station, TX, USA
We present an inference-based surface reconstruction algorithm that is capable of identifying objects of interest among a cluttered scene, and reconstructing solid model representations even in the presence of occluded surfaces. Our proposed approach incorporates a predictive modeling framework that uses a set of user-provided models for prior knowledge, and applies this knowledge to the iterative identification and construction process. Our approach uses a local to global construction process guided by rules for fitting high-quality surface patches obtained from these prior models. We demonstrate the application of this algorithm on several example data sets containing heavy clutter and occlusion.

[1] Y. Lamdan and H. Wolfson, "Geometric Hashing: A General and Efficient Model-Based Recognition Scheme," Proc. Second Int'l Conf. Computer Vision, pp. 238-249, Dec. 1988.
[2] A. Johnson and M. Hebert, "Using Spin Images for Efficient Object Recognition in Cluttered 3D Scenes," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 21, no. 5, pp. 433-449, May 1999.
[3] A. Frome, D. Huber, R. Kolluri, T. Bülow, and J. Malik, "Recognizing Objects in Range Data Using Regional Point Descriptors," Proc. European Conf. Computer Vision, pp. 224-237, 2004.
[4] A.S. Mian, M. Bennamoun, and R. Owens, "Three-Dimensional Model-Based Object Recognition and Segmentation in Cluttered Scenes," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 28, no. 10, pp. 1584-1601, Oct. 2006.
[5] N. Amenta, M. Bern, and M. Kamvysselis, "A New Voronoi-Based Surface Reconstruction Algorithm," Proc. SIGGRAPH, pp. 415-421, 1998.
[6] T.K. Dey, J. Giesen, and J. Hudson, "Delaunay Based Shape Reconstruction from Large Data," Proc. IEEE Symp. Parallel and Large-Data Visualization and Graphics, pp. 19-27, 2001.
[7] J. Carr, R. Beatson, J. Cherrie, T. Mitchell, W. Fright, B. McCallum, and T. Evans, "Reconstruction and Representation of 3D Objects with Radial Basis Functions," Proc. SIGGRAPH, pp. 67-76, 2001.
[8] M. Alexa, J. Behr, D. Cohen-Or, S. Fleishman, D. Levin, and C.T. Silva, "Computing and Rendering Point Set Surfaces," IEEE Trans. Visualization and Computer Graphics, vol. 9, no. 1, pp. 3-15, Jan.-Mar. 2003.
[9] M. Kazhdan, M. Bolitho, and H. Hoppe, "Poisson Surface Reconstruction," Proc. Fourth Eurographics Symp. Geometry Processing, pp. 61-70, 2006.
[10] P. Jenke, M. Wand, and W. Straßer, "Patch-Graph Reconstruction for Piecewise Smooth Surfaces," Proc. Vision, Modeling and Visualization (VMV '08), 2008.
[11] J. Davis, S. Marschner, M. Garr, and M. Levoy, "Filling Holes in Complex Surfaces Using Volumetric Diffusion," Proc. First Int'l Symp. 3D Data Processing, Visualization, and Transmission, pp. 428-861, 2002.
[12] A. Sharf, M. Alexa, and D. Cohen-Or, "Context-Based Surface Completion," ACM Trans. Graphics, vol. 23, no. 3, pp. 878-887, 2004.
[13] M. Pauly, N.J. Mitra, J. Giesen, L.J. Guibas, and M. Gross, "Example-Based 3D Scan Completion," SGP '05: Proc. Third Eurographics Symp. Geometry Processing, pp. 23-32, 2005.
[14] V. Kraevoy and A. Sheffer, "Template-Based Mesh Completion," Proc. Third Eurographics Symp. Geometry Processing, pp. 13-22, 2005.
[15] R. Gal, A. Shamir, T. Hassner, M. Pauly, and D. Cohen-Or, "Surface Reconstruction Using Local Shape Priors," Proc. Fifth Eurographics Symp. Geometry Processing, pp. 253-262, 2007.
[16] R. Schnabel, P. Degener, and R. Klein, "Completion and Reconstruction with Primitive Shapes," Computer Graphics Forum, vol. 28, no. 2, pp. 503-512, 2009.
[17] M. Sonka, V. Hlavac, and R. Boyle, Image Processing, Analysis, and Machine Vision. Int'l Thomson Publishing, 1998.
[18] R.J. Campbell and P.J. Flynn, "A Survey of Free-Form Object Representation and Recognition Tech," Computer Vision and Image Understanding, vol. 81, no. 2, pp. 166-210, 2001.
[19] E. Borenstein and J. Malik, "Shape Guided Object Segmentation," Proc. IEEE CS Conf. Computer Vision and Pattern Recognition, pp. 969-976, 2006.
[20] T. Cour and J. Shi, "Recognizing Objects by Piecing Together the Segmentation Puzzle," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 1-8, June 2007.
[21] A. Mian, M. Bennamoun, and R. Owens, "On the Repeatability and Quality of Keypoints for Local Feature-based 3D Object Retrieval from Cluttered Scenes," Int'l J. Computer Vision, vol. 89, pp. 348-361, Sept. 2010.
[22] B. Drost, M. Ulrich, N. Navab, and S. Ilic, "Model Globally, Match Locally: Efficient and Robust 3D Object Recognition," Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR '10), pp. 998-1005, June 2010.
[23] D. Huber, A. Kapuria, R.R. Donamukkala, and M. Hebert, "Parts-Based 3D Object Classification," Proc. IEEE Conf. Computer Vision and Pattern Recognition, June 2004.
[24] D. Aiger, N.J. Mitra, and D. Cohen-Or, "4-Points Congruent Sets for Robust Surface Registration," ACM Trans. Graphics, vol. 27, no. 3, pp. 1-10, 2008.
[25] P.J. Besl and N.D. McKay, "A Method for Registration of 3-D Shapes," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 14, no. 2, pp. 239-256, Feb. 1992.
[26] S. Rusinkiewicz and M. Levoy, "Efficient Variants of the ICP Algorithm," Proc. Third Int'l Conf. 3-D Digital Imaging and Modeling, pp. 145-152, 2001.
[27] J.W. Tangelder and R.C. Veltkamp, "A Survey of Content Based 3D Shape Retrieval Methods," Proc. Shape Modeling Applications, pp. 145-156, 2004.
[28] B. Bustos, D.A. Keim, D. Saupe, T. Schreck, and D.V. Vranić, "Feature-Based Similarity Search in 3D Object Databases," ACM Computing Surveys, vol. 37, no. 4, pp. 345-387, 2005.
[29] T. Funkhouser, M. Kazhdan, P. Min, and P. Shilane, "Shape-Based Retrieval and Analysis of 3D Models," Comm. ACM, vol. 48, no. 6, pp. 58-64, 2005.
[30] R. Schnabel, R. Wahl, and R. Klein, "Efficient Ransac for Point-Cloud Shape Detection," Computer Graphics Forum, vol. 26, no. 2, pp. 214-226, 2007.
[31] R. Schnabel, R. Wessel, R. Wahl, and R. Klein, "Shape Recognition in 3D Point-Clouds," Proc. 16th Int'l Conf. Central Europe on Computer Graphics, Visualization and Computer Vision, V. Skala, ed., 2008.
[32] T. Funkhouser, M. Kazhdan, P. Shilane, P. Min, W. Kiefer, A. Tal, S. Rusinkiewicz, and D. Dobkin, "Modeling by Example," ACM Trans. Graphics, vol. 23, no. 3, pp. 652-663, 2004.
[33] V. Kraevoy, D. Julius, and A. Sheffer, "Model Composition from Interchangeable Components," Proc. 15th Pacific Conf. Computer Graphics and Applications, pp. 129-138, 2007.
[34] R. Gal and D. Cohen-Or, "Salient Geometric Features for Partial Shape Matching and Similarity," ACM Trans. Graphics, vol. 25, no. 1, pp. 130-150, 2006.
[35] S. Shalom, L. Shapira, A. Shamir, and D. Cohen-Or, "Part Analogies in Sets of Objects," Proc. Eurographics Symp. 3D Object Retrieval, pp. 33-40, 2008.
[36] M. Pauly, N.J. Mitra, J. Wallner, H. Pottmann, and L.J. Guibas, "Discovering Structural Regularity in 3D Geometry," ACM Trans. Graphics, vol. 27, no. 3, pp. 1-11, 2008.
[37] A. Berner, M. Bokeloh, M. Wand, A. Schilling, and H.-P. Seidel, "A Graph-Based Approach to Symmetry Detection," Proc. IEEE/EG Int'l Symp. Vol. and Point-Based Graphics, pp. 1-8, 2008.
[38] M. Bokeloh, A. Berner, M. Wand, H.-P. Seidel, and A. Schilling, "Symmetry Detection Using Feature Lines," Computer Graphics Forum, vol. 28, no. 2, pp. 697-706, 2009.
[39] J.J. Shah, D. Anderson, Y. Se Kim, and S. Joshi, "A Discourse on Geometric Feature Recognition from Cad Models," J. Computing and Information Science in Eng., vol. 1, no. 1, pp. 41-51, 2001.
[40] G. Turk, "Re-Tiling Polygonal Surfaces," Proc. SIGGRAPH, pp. 55-64, 1992.
[41] M. Elad, A. Tal, and S. Ar, "Content Based Retrieval of Vrml Objects: An Iterative and Interactive Approach," Proc. Sixth Eurographics Workshop Multimedia, pp. 107-118, 2002.
[42] N. Amenta and Y.J. Kil, "Defining Point-Set Surfaces," ACM Trans. Graphics, vol. 23, no. 3, pp. 264-270, 2004.
[43] Z.-Q. Cheng, Y.-Z. Wang, B. Li, K. Xu, G. Dang, and S.-Y. Jin, "A Survey of Methods for Moving Least Squares Surfaces," Proc. IEEE/EG Symp. Vol. and Point-Based Graphics, 2008.
[44] W.E. Lorensen and H.E. Cline, "Marching Cubes: A High Resolution 3D Surface Construction Algorithm," Proc. SIGGRAPH, pp. 163-169, 1987.
[45] T. Ju, F. Losasso, S. Schaefer, and J. Warren, "Dual Contouring of Hermite Data," ACM Trans. Graphics, vol. 21, no. 3, pp. 339-346, 2002.
[46] Univ. of Washington Computer Science, "Bundler: Structure from Motion for Unordered Image Collections," http://phototour.cs. washington.edubundler /, 2010.
[47] Univ. of Washington Computer Science, "Clustering Views for Multi-View Stereo (cmvs)," http://grail.cs.washington.edu/ software cmvs/, 2010.

Index Terms:
surface reconstruction,hidden feature removal,solid modelling,construction process,surface reconstruction,cluttered environments,inference based surface reconstruction,solid model representations,occluded surfaces,predictive modeling,user provided models,iterative identification,Surface reconstruction,Object recognition,Solid modeling,Shape,Surface treatment,Solids,Computational modeling,surface fitting.,Three-dimensional/stereo scene analysis,object recognition,segmentation
Citation:
K. Biggers, J. Keyser, "Inference-Based Surface Reconstruction of Cluttered Environments," IEEE Transactions on Visualization and Computer Graphics, vol. 18, no. 8, pp. 1255-1267, Aug. 2012, doi:10.1109/TVCG.2011.263
Usage of this product signifies your acceptance of the Terms of Use.