This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Shape Estimation of Transparent Objects by Using Inverse Polarization Ray Tracing
November 2007 (vol. 29 no. 11)
pp. 2018-2030
Few methods have been proposed to measure three-dimensional shapes of transparent objects such as those made of glass and acrylic. In this paper, we propose a novel method for estimating the surface shapes of transparent objects by analyzing the polarization state of the light. Existing methods do not fully consider the reflection, refraction, and transmission of the light occurring inside a transparent object. We employ a polarization raytracing method to compute both the path of the light and its polarization state. Polarization raytracing is a combination of conventional raytracing, which calculates the trajectory of light rays, and Mueller calculus, which calculates the polarization state of the light. First, we set an initial value of the shape of the transparent object. Then, by changing the shape, the method minimizes the difference between the input polarization data and the rendered polarization data calculated by polarization raytracing. Finally, after the iterative computation is converged, the shape of the object is obtained. We also evaluate the method by measuring some real transparent objects.

[1] G.A. Atkinson and E.R. Hancock, “Recovery of Surface Orientation from Diffuse Polarization,” IEEE Trans. Image Processing, vol. 15, no. 6, pp. 1653-1664, 2006.
[2] G.A. Atkinson and E.R. Hancock, “Polarization-Based Surface Reconstruction via Patch Matching,” Proc. IEEE CS Conf. Computer Vision and Pattern Recognition, pp. 495-502, 2006.
[3] M. Ben-Ezra and S.K. Nayar, “What Does Motion Reveal about Transparency?” Proc. IEEE Int'l Conf. Computer Vision, pp. 1025-1032, 2003.
[4] M. Born and E. Wolf, Principles of Optics, p. 803. Pergamon Press, 1959.
[5] R.A. Chipman, “Mechanics of Polarization Ray Tracing,” Optical Eng., vol. 34, no. 6, pp. 1636-1645, 1995.
[6] R. Courant and D. Hilbert, Methods of Mathematical Physics, p. 577. John Wiley & Sons, 1953.
[7] S. Guy and C. Soler, “Graphics Gems Revisited: Fast and Physically-Based Rendering of Gemstones,” ACM Trans. Graphics, vol. 23, no. 3, pp. 231-238, 2004.
[8] S. Hata, Y. Saitoh, S. Kumamura, and K. Kaida, “Shape Extraction of Transparent Object Using Genetic Algorithm,” Proc. Int'l Conf. Pattern Recognition, pp. 684-688, 1996.
[9] E. Hecht, Optics, p. 698. Addison-Wesley, 2002.
[10] B.K.P. Horn, Robot Vision, p. 509. MIT Press, 1986.
[11] B.K.P. Horn, “Height and Gradient from Shading,” Int'l J. Computer Vision, vol. 5, no. 1, pp. 37-75, 1990.
[12] K. Ikeuchi and B.K.P. Horn, “Numerical Shape from Shading and Occluding Boundaries,” Artificial Intelligence, vol. 17, pp. 141-184, 1981.
[13] K. Ikeuchi, “Reconstructing a Depth Map from Intensity Maps,” Proc. Int'l Conf. Pattern Recognition, pp. 736-738, 1984.
[14] K. Koshikawa and Y. Shirai, “A Model-Based Recognition of Glossy Objects Using Their Polarimetrical Properties,” Advanced Robotics, vol. 2, no. 2, pp. 137-147, 1987.
[15] K.N. Kutulakos and E. Steger, “A Theory of Refractive and Specular 3D Shape by Light-Path Triangulation,” Proc. IEEE Int'l Conf. Computer Vision, pp. 1448-1457, 2005.
[16] D. Miyazaki, M. Saito, Y. Sato, and K. Ikeuchi, “Determining Surface Orientations of Transparent Objects Based on Polarization Degrees in Visible and Infrared Wavelengths,” J. Optical Soc. Am. A, vol. 19, no. 4, pp. 687-694, 2002.
[17] D. Miyazaki, R.T. Tan, K. Hara, and K. Ikeuchi, “Polarization-Based Inverse Rendering from a Single View,” Proc. IEEE Int'l Conf. Computer Vision, pp. 982-987, 2003.
[18] D. Miyazaki, M. Kagesawa, and K. Ikeuchi, “Transparent Surface Modeling from a Pair of Polarization Images,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 26, no. 1, pp. 73-82, Jan. 2004.
[19] N.J.W. Morris and K.N. Kutulakos, “Dynamic Refraction Stereo,” Proc. IEEE Int'l Conf. Computer Vision, pp. 1573-1580, 2005.
[20] H. Murase, “Surface Shape Reconstruction of a Nonrigid Transparent Object Using Refraction and Motion,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 14, no. 10, pp. 1045-1052, Oct. 1992.
[21] W.H. Press, S.A. Teukolsky, W.T. Vetterling, and B.P. Flannery, Numerical Recipes in C: The Art of Scientific Computing, p. 994. Cambridge Univ. Press, 1992.
[22] S. Rahmann and N. Canterakis, “Reconstruction of Specular Surfaces Using Polarization Imaging,” Proc. IEEE CS Conf. Computer Vision and Pattern Recognition, pp. 149-155, 2001.
[23] M. Saito, Y. Sato, K. Ikeuchi, and H. Kashiwagi, “Measurement of Surface Orientations of Transparent Objects by Use of Polarization in Highlight,” J. Optical Soc. Am. A, vol. 16, no. 9, pp. 2286-2293, 1999.
[24] Y.Y. Schechner, J. Shamir, and N. Kiryati, “Polarization and Statistical Analysis of Scenes Containing a Semireflector,” J.Optical Soc. Am. A, vol. 17, no. 2, pp. 276-284, 2000.
[25] D.C. Tannenbaum, P. Tannenbaum, and M.J. Wozny, “Polarization and Birefringency Considerations in Rendering,” Proc. ACM Ann. Conf. Computer Graphics, pp. 221-222, 1994.
[26] A. Wilkie, R.F. Tobler, and W. Purgathofer, “Combined Rendering of Polarization and Fluorescence Effects,” Proc. Eurographics Workshop Rendering, pp. 197-204, 2001.
[27] L.B. Wolff and D.J. Kurlander, “Ray Tracing with Polarization Parameters,” IEEE Computer Graphics and Applications, vol. 10, no. 6, pp. 44-55, 1990.
[28] L.B. Wolff and T.E. Boult, “Constraining Object Features Using a Polarization Reflectance Model,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 13, no. 7, pp. 635-657, July 1991.

Index Terms:
Polarization, Raytracing, Shape-from-X, Transparency, Mueller calculus
Citation:
Daisuke Miyazaki, Katsushi Ikeuchi, "Shape Estimation of Transparent Objects by Using Inverse Polarization Ray Tracing," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 29, no. 11, pp. 2018-2030, Nov. 2007, doi:10.1109/TPAMI.2007.1117
Usage of this product signifies your acceptance of the Terms of Use.