The Community for Technology Leaders
RSS Icon
Issue No.10 - October (2010 vol.32)
pp: 1770-1780
Zhan Song , Chinese Academy of Sciences, ShenZhen
Chi-Kit Ronald Chung , The Chinese University of Hong Kong, Hong Kong
Position and orientation profiles are two principal descriptions of shape in space. We describe how a structured light system, coupled with the illumination of a pseudorandom pattern and a suitable choice of feature points, can allow not only the position but also the orientation of individual surface elements to be determined independently. Unlike traditional designs which use the centroids of the illuminated pattern elements as the feature points, the proposed design uses the grid points between the pattern elements instead. The grid points have the essences that their positions in the image data are inert to the effect of perspective distortion, their individual extractions are not directly dependent on one another, and the grid points possess strong symmetry that can be exploited for their precise localization in the image data. Most importantly, the grid lines of the illuminated pattern that form the grid points can aid in determining surface normals. In this paper, we describe how each of the grid points can be labeled with a unique color code, what symmetry they possess and how the symmetry can be exploited for their precise localization at subpixel accuracy in the image data, and how 3D orientation in addition to 3D position can be determined at each of them. Both the position and orientation profiles can be determined with only a single pattern illumination and a single image capture.
Structured light system, 3D reconstruction, surface orientation, feature detection.
Zhan Song, Chi-Kit Ronald Chung, "Determining Both Surface Position and Orientation in Structured-Light-Based Sensing", IEEE Transactions on Pattern Analysis & Machine Intelligence, vol.32, no. 10, pp. 1770-1780, October 2010, doi:10.1109/TPAMI.2009.192
[1] D. Nehab et al., "Efficiently Combining Positions and Normals for Precise 3D Geometry," ACM Trans. Graphics, vol. 24, no. 3, pp. 536-543, 2005.
[2] K. Ikeuchi and B.K.P. Horn, "Numerical Shape from Shading and Occluding Boundaries," Artificial Intelligence, vol. 17, no. 3, pp. 141-184, 1981.
[3] R.J. Campbell and P.J. Flyn, "A Survey of Free-Form Object Representation and Recognition Techniques," Computer Vision and Image Understanding, vol. 81, pp. 166-210, 2001.
[4] R. Zhang, P. Tsai, J.E. Cryer, and M. Shah, "Shape from Shading: A Survey," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 21, no. 8, pp. 690-705, Aug. 1999.
[5] J. Garding, "Direct Estimation of Shape from Texture," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 15, no. 11, pp. 1202-1208, Nov. 1993.
[6] J. Salvi, J. Pagès, and J. Batlle, "Pattern Codification Strategies in Structured Light Systems," Pattern Recognition, vol. 37, no. 4, pp. 827-849, 2004.
[7] S. Kiyasu et al., "Measurement of the 3-D Shape of Specular Polyhedrons Using an M-Array Coded Light Source," IEEE Trans. Instrumentation and Measurement, vol. 44, no. 3, pp. 775-778, June 1995.
[8] P. Fong and F. Buron, "High-Resolution Three Dimensional Sensing of Fast Deforming Objects," Proc. Int'l. Conf. Intelligent Robotics and Systems, pp. 1606-1611, 2005.
[9] D. Desjardins and P. Payeur, "Dense Stereo Range Sensing with Marching Pseudorandom Patterns," Proc. Canadian Conf. Computer and Robot Vision, pp. 216-226, 2007.
[10] P. Griffin, L. Narasimhan, and S. Yee, "Generation of Uniquely Encoded Light Patterns for Range Data Acquisition," Pattern Recognition, vol. 25, no. 6, pp. 609-616, 1992.
[11] J. Salvi, J. Batlle, and E. Mouaddib, "A Robust-Coded Pattern Projection for Dynamic 3D Scene Measurement," Pattern Recognition Letters, vol. 19, pp. 1055-1065, 1998.
[12] Y.C. Hsieh, "Decoding Structured Light Patterns for Three-Dimensional Imaging Systems," Pattern Recognition, vol. 34, no. 2, pp. 343-349, 2001.
[13] S.Y. Chen and Y.F. Li, "Vision Processing for Realtime 3-D Data Acquisition Based on Coded Structured Light," IEEE Trans. Image Processing, vol. 17, no. 2, pp. 167-176, Feb. 2008.
[14] R.A. Morano et al., "Structured Light Using Pseudorandom Codes," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 20, no. 3, pp. 322-327, Mar. 1998.
[15] C.J. Davies and M.S. Nixon, "A Hough Transform for Detecting the Location and Orientation of Three-Dimensional Surfaces via Color Encoded Spots," IEEE Trans. Systems, Man, and Cybernetics, Part B, vol. 28, no. 1, pp. 90-95, Feb. 1998.
[16] I. Ishii et al., "High-Speed 3D Image Acquisition Using Coded Structured Light Projection," Proc. Int'l. Conf. Intelligent Robots and Systems, pp. 925-930, 2007.
[17] F. Gray, "Pulse Code Communication," US Patent 2632058, Mar. 1953.
[18] R.J. Valkenburg and A.M. McIvor, "Accurate 3D Measurement Using a Structured Light System," Image and Vision Computing, vol. 16, no. 2, pp. 99-110, 1998.
[19] W. Krattenthaler, K.J. Mayer, and H.P. Duwe, "3D-Surface Measurement with Coded Light Approach," Proc. 17th Meeting Austrian Assoc. for Pattern Recognition on Image Analysis and Synthesis, pp. 103-114, 1994.
[20] S. Zhang and P.S. Huang, "High-Resolution, Real-Time Three-Dimensional Shape Measurement," Optical Eng., vol. 45, no. 12, p. 123601, 2006.
[21] D. Scharstein and R. Szeliski, "High-Accuracy Stereo Depth Maps Using Structured Light," Proc. IEEE CS Conf. Computer Vision and Pattern Recognition, vol. 1, pp. 195-202, 2003.
[22] F. Sadlo and T. Weyrich, "A Practical Structured Light Acquisition System for Point-Based Geometry and Texture," Proc. Eurographics Symp. Point-Based Graphics, pp. 89-98, 2005.
[23] J. Gühring, "Dense 3D Surface Acquisition by Structured Light Using Off-the-Shelf Components," Proc. Int'l Soc. Optical Eng., pp. 220-231, 2000.
[24] Z. Song and R. Chung, "Off-the-Shelf Structured Light-Based System for Accurate 3D Reconstruction," HKIE Trans., vol. 15, no. 4, pp. 44-51, 2008.
[25] P. Vuylsteke and A. Oosterlinck, "Range Image Acquisition with a Single Binary-Encoded Light Pattern," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 12, no. 2, pp. 148-163, Feb. 1990.
[26] A. Adan et al., "3D Feature Tracking Using a Dynamic Structured Light System," Proc. Second Canadian Conf. Computer and Robot Vision, pp. 168-175, 2005.
[27] I.C. Albitar, P. Graebling, and C. Doignon, "Robust Structured Light Coding for 3D Reconstruction Computer Vision," Proc. IEEE Int'l Conf. Computer Vision, pp. 1-6, 2007.
[28] L. Zhang, B. Curless, and S. Seitz, "Rapid Shape Acquisition Using Color Structured Light and Multi-Pass Dynamic Programming," Proc. First Int'l Symp. 3D Data Processing, Visualization, and Transmission, pp. 22-36, 2002.
[29] C.S. Chen, Y.P. Hung, C.C. Chiang, and J.L. Wu, "Range Data Acquisition Using Color Structured Lighting and Stereo Vision," Image and Vision Computing, vol. 15, no. 6, pp. 445-456, 1997.
[30] J. Pages, J. Salvi, and J. Forest, "Optimized De Bruijn Patterns for One-Shot Shape Acquisition," Image and Vision Computing, vol. 23, no. 8, pp. 707-720, 2005.
[31] G. Healey and T.O. Binford, "Local Shape from Specularity," Proc. IEEE Int'l Conf. Computer Vision, vol. 1, pp. 151-160, 1987.
[32] D. Miyazaki, M. Saito, Y. Sato, and K. Ikeuchi, "Determining Surface Orientations of Transparent Objects Based on Polarization Degrees in Visible and Infrared Wavelengths," J. Optical Soc. Am. A, vol. 19, pp. 687-694, 2002.
[33] R.J. Woodham, "Photometric Method for Determining Surface Orientation from Multiple Images," Optical Eng., vol. 19, no. 1, pp. 139-144, 1980.
[34] N. Shrikhande and G. Stockman, "Surface Orientation from a Projected Grid," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 11, no. 6, pp. 650-655, June 1989.
[35] S. Winkelbach and F.M. Wahl, "Shape from 2D Edge Gradients," Proc. 23rd DAGM Symp. Pattern Recognition, pp. 377-384, 2001.
[36] S. Winkelbach and F.M. Wahl, "Shape from Single Stripe Pattern Illumination," Proc. 24th DAGM Symp. Pattern Recognition, pp. 240-247, 2002.
[37] F.J. MacWilliams and N.J.A. Sloane, "Pseudo-Random Sequences and Arrays," Proc. IEEE, vol. 64, no. 12, pp. 1715-1729, Dec. 1976.
[38] D. Marr and E. Hildreth, "Theory of Edge Detection," Proc. Royal Soc. London, vol. 207, pp. 187-217, 1980.
[39] C. Harris and M.J. Stephens, "A Combined Corner and Edge Detector," Proc. Fourth Alvey Vision Conf., pp. 147-152, 1998.
[40] S.M. Smith and M. Brady, "SUSAN—A New Approach to Low Level Image Processing," Int'l. J. Computer Vision, vol. 23, no. 1, pp. 45-78, 1997.
[41] J. Cohen, Statistical Power Analysis for the Behavioral Sciences. Lawrence Erlbaum Assoc., 1988.
[42] Z. Song and R. Chung, "Grid-Point Extraction Exploiting Point Symmetry in a Pseudorandom Color Pattern," Proc. Int'l. Conf. Image Processing, pp. 1956-1959, 2008.
[43] Z. Song and R. Chung, "Use of LCD Panel for Calibrating Structured Light-Based Range Sensing System," IEEE Trans. Instrumentation and Measurement, vol. 57, no. 11, pp. 2623-2630, Nov. 2008.
29 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool