The Community for Technology Leaders
RSS Icon
Issue No.02 - March/April (2008 vol.14)
pp: 246-262
We present a system for constructing 3D models of real-world objects with optically challenging surfaces. The system utilizes a new range imaging concept called multi-peak range imaging, which stores multiple candidates of range measurements for each point on the object surface. The multiple measurements include the erroneous range data caused by various surface properties that are not ideal for structured-light range sensing. False measurements generated by spurious reflections are eliminated by applying a series of constraint tests. The constraint tests based on local surface and local sensor visibility are applied first to individual range images. The constraint tests based on global consistency of coordinates and visibility are then applied to all range images acquired from different viewpoints. We show the effectiveness of our method by constructing 3D models of five different optically challenging objects. To evaluate the performance of the constraint tests and to examine the effects of the parameters used in the constraint tests, we acquired the ground truth data by painting those objects to suppress the surface-related properties that cause difficulties in range sensing. Experimental results indicate that our method significantly improves upon the traditional methods for constructing reliable 3D models of optically challenging objects.
Range data, geometric modeling, image analysis, virtual reality, feature representation
Johnny Park, Avinash Kak, "3D Modeling of Optically Challenging Objects", IEEE Transactions on Visualization & Computer Graphics, vol.14, no. 2, pp. 246-262, March/April 2008, doi:10.1109/TVCG.2007.1069
[1] B. Curless and M. Levoy, “A Volumetric Method for Building Complex Models from Range Images,” Proc. ACM SIGGRAPH '96, pp. 303-312, 1996.
[2] K. Pulli, “Multiview Registration for Large Data Sets,” Proc. Second Int'l Conf. 3D Digital Imaging and Modeling (3DIM '99), pp. 160-168, 1999.
[3] M. Levoy, K. Pulli, B. Curless, S. Rusinkiewicz, D. Koller, L. Pereira, M. Ginzton, S. Anderson, J. Davis, J. Ginsberg, J. Shade, and D. Fulk, “The Digital Michelangelo Project: 3D Scanning of Large Statues,” Proc. ACM SIGGRAPH '00, pp. 131-144, 2000.
[4] Modeling from Reality, K. Ikeuchi and Y. Sato, eds. Kluwer Academic Publishers, 2001.
[5] H.P.A. Lensch, J. Kautz, M. Goesele, W. Heidrich, and H.-P. Seidel, “Image-Based Reconstruction of Spatially Varying Materials,” Proc. 12th Eurographics Workshop Rendering, 2001.
[6] F. Bernardini, I. Martin, J. Mittleman, H. Rushmeier, and G. Taubin, “Building a Digital Model of Michelangelo's Florentine Pietà,” IEEE Computer Graphics and Applications, vol. 22, no. 1, pp.59-67, 2002.
[7] S. Rusinkiewicz, O. Hall-Holt, and M. Levoy, “Real-Time 3D Model Acquisition,” ACM Trans. Graphics, vol. 21, no. 3, pp. 438-446, 2002.
[8] D. Huber and M. Hebert, “Fully Automatic Registration of Multiple 3D Data Sets,” Image and Vision Computing, vol. 21, no. 7, pp. 637-650, July 2003.
[9] A. Kalaiah and A. Varshney, “Modeling and Rendering of Points with Local Geometry,” IEEE Trans. Visualization and Computer Graphics, vol. 9, no. 1, pp. 30-42, 2003.
[10] Y. Sato, M. Wheeler, and K. Ikeuchi, “Object Shape and Reflectance Modeling from Observation,” Proc. ACM SIGGRAPH '97, pp. 379-387, 1997.
[11] T. Masuda, “Generation of Geometric Model by Registration and Integration of Multiple Range Images,” Proc. Third Int'l Conf. 3D Digital Imaging and Modeling (3DIM '01), pp. 254-261, 2001.
[12] P.J. Besl, “Active Optical Range Imaging Sensors,” Advances in Machine Vision, Springer-Verlag, pp. 1-63, 1989.
[13] P.J. Besl and N.D. McKay, “A Method for Registration of 3-D Shapes,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 14, no. 2, pp. 239-256, 1992.
[14] Z. Zhang, “Iterative Point Matching for Registration of Free-Form Curves and Surfaces,” Int'l J. Computer Vision, vol. 13, no. 2, pp.119-152, 1994.
[15] G. Godin, D. Laurendeau, and R. Bergevin, “A Method for the Registration of Attributed Range Images,” Proc. Third Int'l Conf. 3D Digital Imaging and Modeling (3DIM '01), pp. 179-186, 2001.
[16] R. Bergevin, M. Soucy, H. Gagnon, and D. Laurendeau, “Towards a General Multiview Registration Technique,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 18, no. 5, pp. 540-547, 1996.
[17] R. Benjemaa and F. Schmitt, “Fast Global Registration of 3D Sampled Surfaces Using a Multi-Z-Buffer Technique,” Proc. Conf. Recent Advances in 3-D Digital Imaging and Modeling (3DIM '97), pp.113-120, 1997.
[18] I. Stamos and M. Leordeanu, “Automated Feature-Based Range Registration of Urban Scenes of Large Scale,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 555-561, June 2003.
[19] N. Gelfand, N. Mitra, L. Guibas, and H. Pottmann, “Robust Global Registration,” Proc. Third Symp. Geometry Processing (SGP '05), 2005.
[20] H. Hoppe, T. DeRose, T. Duchamp, J. McDonald, and W. Stuetzle, “Surface Reconstruction from Unorganized Points,” Proc. ACM SIGGRAPH '92, pp. 71-78, 1992.
[21] W.E. Lorensen and H.E. Cline, “Marching Cubes: A High Resolution 3D Surface Construction Algorithm,” Proc. ACM SIGGRAPH '87, pp. 163-169, 1987.
[22] M. Soucy and D. Laurendeau, “A General Surface Approach to the Integration of a Set of Range Views,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 17, no. 4, pp. 344-358, 1995.
[23] G. Turk and M. Levoy, “Zippered Polygon Meshes from Range Images,” Proc. ACM SIGGRAPH '94, pp. 311-318, 1994.
[24] F. Bernardini, J. Mittleman, H. Rushmeier, C. Silva, and G. Taubin, “The Ball-Pivoting Algorithm for Surface Reconstruction,” IEEE Trans. Visualization and Computer Graphics, vol. 5, no. 4, pp. 349-359, 1999.
[25] B. Curless and M. Levoy, “Better Optical Triangulation through Spacetime Analysis,” Proc. Fifth IEEE Int'l Conf. Computer Vision (ICCV '95), pp. 987-994, 1995.
[26] S. Nayar, K. Ikeuchi, and T. Kanade, “Recovering Shape in the Presence of Interreflections,” Proc. IEEE Int'l Conf. Robotics and Automation (ICRA '91), vol. 2, pp. 1814-1819, Apr. 1991.
[27] J. Clark, E. Trucco, and L.B. Wolff, “Using Light Polarization in Laser Scanning,” Image and Vision Computing, vol. 15, no. 1, pp.107-117, 1997.
[28] E. Trucco and R.B. Fisher, “Acquisition of Consistent Range Data Using Local Calibration,” Proc. IEEE Int'l Conf. Robotics and Automation (ICRA '94), pp. 3410-3415, 1994.
[29] J. Park and A. Kak, “Multi-Peak Range Imaging for Accurate 3D Reconstruction of Specular Objects,” Proc. Sixth Asian Conf. Computer Vision (ACCV '04), 2004.
[30] J. Park and A. Kak, “Specularity Elimination in Range Sensing for Accurate 3D Modeling of Specular Objects,” Proc. Second Int'l Symp. 3D Data Processing, Visualization, and Transmission (3DPVT '04), 2004.
[31] J. Shade, S. Gortler, L.-W. He, and R. Szeliski, “Layered Depth Images,” Proc. ACM SIGGRAPH '98, pp. 231-242, 1998.
[32] P.J. Besl and R.C. Jain, “Segmentation through Variable-Order Surface Fitting,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 10, no. 2, pp. 167-192, 1988.
[33] C.H. Chen and A.C. Kak, “3D-POLY: A Robot Vision System for Recognizing Objects in Occluded Environments,” Technical Report TR-EE 88-48, Purdue Univ., 1988.
[34] A. Rosenfeld and A.C. Kak, Digital Picture Processing. Academic Press, 1982.
[35] M. Oren and S.K. Nayar, “Generalization of the Lambertian Model and Implications for Machine Vision,” Int'l J. Computer Vision, vol. 14, no. 2, pp. 227-251, 1995.
[36] M.A. Fischler and R.C. Bolles, “Random Sample Consensus: A Paradigm for Model Fitting with Applications to Image Analysis and Automated Cartography,” Comm. ACM, vol. 24, no. 6, pp. 381-395, 1981.
[37] A. Stoddart, S. Lemke, A. Hilton, and T. Penn, “Estimating Pose Uncertainty for Surface Registration,” Proc. British Machine Vision Conf. (BMVC '96), pp. 23-32, 1996.
[38] K.N. Kutulakos and S.M. Seitz, “A Theory of Shape by Space Carving,” Int'l J. Computer Vision, vol. 38, no. 3, pp. 199-218, 2000.
[39] K. Pulli, M. Cohen, T. Duchamp, H. Hoppe, L. Shapiro, and W. Stuetzle, “View-Based Rendering: Visualizing Real Objects from Scanned Range and Color Data,” Proc. Eighth Eurographics Workshop Rendering, pp. 23-34, 1997.
[40] J.L. Bentley, “Multidimensional Binary Search Trees Used for Associative Searching,” Comm. ACM, vol. 18, no. 9, pp. 509-517, Sept. 1975.
[41] J.G. Cleary, “Analysis of an Algorithm for Finding Nearest Neighbors in Euclidean Space,” ACM Trans. Math. Software, vol. 5, no. 2, pp. 183-192, June 1979.
[42] J.H. Friedman, J.L. Bentley, and R.A. Finkel, “An Algorithm for Finding Best Matches in Logarithmic Expected Time,” ACM Trans. Math. Software, vol. 3, no. 3, pp. 209-226, Sept. 1977.
408 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool