• Publication
  • 2004
  • Issue No. 5 - May
  • Abstract - Separation of Diffuse and Specular Components of Surface Reflection by Use of Polarization and Statistical Analysis of Images
 This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Separation of Diffuse and Specular Components of Surface Reflection by Use of Polarization and Statistical Analysis of Images
May 2004 (vol. 26 no. 5)
pp. 639-647
Shinji Umeyama, IEEE Computer Society
Guy Godin, IEEE

Abstract—The image of an opaque object is created by observing the reflection of the light incident on its surface. The dichromatic reflection model describes the surface reflection as the sum of two components, diffuse and specular terms. The specular reflection component is usually strong in its intensity and polarized significantly compared to the diffuse components. On the other hand, the intensity of the diffuse component is weak and it tends to be unpolarized except near occluding contours. Thus, the observation of an object through a rotating polarizer approximately yields images containing constant diffuse component and specular component of different intensity. In this paper, we show that diffuse and specular components of surface reflection can be separated as two independent components when we apply Independent Component Analysis to the images observed through a polarizer of different orientations. We give a separation simulation of artificial data and also give some separation results of real scenes.

[1] M.S. Bartlett, Face Image Analysis by Unsupervised Learning. Kluwer Academic, 2001.
[2] A.J. Bell and T.J. Sejnowski, An Information-Maximization Approach to Blind Separation and Blind Deconvolution Neural Computation, vol. 7, pp. 1129-1159, 1995.
[3] A.M. Bronstein, M.M. Bronstein, M. Zibulevsky, and Y.Y. Zeevi, Blind Separation of Reflections Using Sparse ICA Proc. Symp. Independent Component Analysis and Blind Signal Separation, pp. 227-232, 2003.
[4] H. Farid and E.H. Adelson, Separating Reflection and Lighting Using Independent Component Analysis Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 262-267, 1999.
[5] H. Farid and E.H. Adelson, Separating Reflections from Images by Use of Independent Component Analysis J. Optical Soc. of Am. A, vol. 16, no. 9, pp. 2136-2145, 1999.
[6] A. Hyvärinen, J. Karhunen, and E. Oja, Independent Component Analysis. Wiley-Interscience, 2001.
[7] F.A. Jenkins and H.E. White, Fundamentals of Optics. McGraw-Hill, 1957.
[8] G.J. Klinker, S.A. Shafer, and T. Kanade, Using a Color Reflection Model to Separate Highlights from Object Color Proc. IEEE First Int'l Conf. Computer Vision, pp. 145-150, 1987.
[9] S. Kodama and N. Suda, Matrix Theory for System Control. The Soc. Industrial and Control Eng. (Japan), 1979, (in Japanese).
[10] S. Makeig, A.J. Bell, T.-P. Jung, and T.J. Sejnovski, Independent Component Analysis of Electroencephalographic Data Advances in Neural Information Processing Systems 8, MIT Press, 1996.
[11] D. Miyazaki, M. Saito, Y. Sato, and K. Ikeuchi, Determining Surface Orientations of Transparent Objects Based on Polarization Degrees in Visible and Infrared Wavelenghts J. Optical Soc. of Am. A, vol. 19, no. 4, pp. 687-694, 2002.
[12] S.K. Nayar, K. Ikeuchi, and T. Kanade, "Surface Reflection: Physical and Geometrical Perspectives," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 13, no. 7, pp. 611-634, 1991.
[13] S.K. Nayar, X. Fang, and T. Boult, Removal of Specularities Using Color and Polarization Proc. Computer Vision and Pattern Recognition, pp. 583-590, 1993.
[14] S.K. Nayar, X. Fang, and T. Boult, Separation of Reflection Components Using Color and Polarization Int'l J. Computer Vision, vol. 21, no. 3, pp. 163-186, 1997.
[15] Y. Sato, M. Wheeler, and K. Ikeuchi, Object Shape and Reflectance Modeling from Observation Proc. SIGGRAPH'97 Conf., pp. 379-387, 1997.
[16] Y. Schechner and J. Shamir, Polarization and Statistical Analysis of Scenes Containing a Semireflector J. Optical Soc. of Am. A, vol. 17, no. 2, pp. 276-284, 2000.
[17] S. Shafer, Using Color to Separate Reflection Components Color Research Applications, vol. 10, pp. 210-218, 1985.
[18] K.E. Torrance and E.M. Sparrow, Theory for Off-Specular Reflection from Roughened Surfaces J. Optical Soc. of Am., vol. 57, no. 9, pp. 1104-1114, 1967.
[19] S. Umeyama, Blind Deconvolution of Images Using Gabor Filters and Independent Component Analysis Proc. Symp. Independent Component Analysis and Blimd Signal Separation, pp. 319-324, 2003.
[20] L.B. Wolff, Using Polarization to Separate Reflectance Components Proc. Conf. Computer Vision and Pattern Recognition, pp. 363-369, 1989.
[21] L.B. Wolff and T.E. Boult, Constraining Object Features Using a Polarization Reflectance Model IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 13, no. 7, pp. 635-657, July 1991.
[22] I. Yamaguchi, Applied Optics. Japan: Ohmsha 1998, (in Japanese).

Index Terms:
Probabilistic independence, mutual information, independent component analysis, diffuse reflection, specular reflection, polarization-based methods.
Citation:
Shinji Umeyama, Guy Godin, "Separation of Diffuse and Specular Components of Surface Reflection by Use of Polarization and Statistical Analysis of Images," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 26, no. 5, pp. 639-647, May 2004, doi:10.1109/TPAMI.2004.1273960
Usage of this product signifies your acceptance of the Terms of Use.