The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.05 - May (2009 vol.31)
pp: 884-899
Soma Biswas , University of Maryland, College Park
Gaurav Aggarwal , Univ. of Maryland, College Park
Rama Chellappa , University of Maryland, College Park
ABSTRACT
We present a nonstationary stochastic filtering framework for the task of albedo estimation from a single image. There are several approaches in the literature for albedo estimation, but few include the errors in estimates of surface normals and light source direction to improve the albedo estimate. The proposed approach effectively utilizes the error statistics of surface normals and illumination direction for robust estimation of albedo, for images illuminated by single and multiple light sources. The albedo estimate obtained is subsequently used to generate albedo-free normalized images for recovering the shape of an object. Traditional Shape-from-Shading (SFS) approaches often assume constant/piecewise constant albedo and known light source direction to recover the underlying shape. Using the estimated albedo, the general problem of estimating the shape of an object with varying albedo map and unknown illumination source is reduced to one that can be handled by traditional SFS approaches. Experimental results are provided to show the effectiveness of the approach and its application to illumination-invariant matching and shape recovery. The estimated albedo maps are compared with the ground truth. The maps are used as illumination-invariant signatures for the task of face recognition across illumination variations. The recognition results obtained compare well with the current state-of-the-art approaches. Impressive shape recovery results are obtained using images downloaded from the Web with little control over imaging conditions. The recovered shapes are also used to synthesize novel views under novel illumination conditions.
INDEX TERMS
Albedo estimation, shape recovery, image estimation, illumination-invariant matching.
CITATION
Soma Biswas, Gaurav Aggarwal, Rama Chellappa, "Robust Estimation of Albedo for Illumination-Invariant Matching and Shape Recovery", IEEE Transactions on Pattern Analysis & Machine Intelligence, vol.31, no. 5, pp. 884-899, May 2009, doi:10.1109/TPAMI.2008.135
REFERENCES
[1] L. Zhang and D. Samaras, “Face Recognition from a Single Training Image under Arbitrary Unknown Lighting Using Spherical Harmonics,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 28, no. 3, pp. 351-363, Mar. 2006.
[2] V. Blanz and T. Vetter, “Face Recognition Based on Fitting a 3D Morphable Model,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 25, no. 9, pp. 1063-1074, Sept. 2003.
[3] S. Romdhani, V. Blanz, and T. Vetter, “Face Identification by Fitting a 3D Morphable Model Using Linear Shape and Texture Error Functions,” Proc. Seventh European Conf. Computer Vision, pp.3-19, 2002.
[4] W.A.P. Smith and E.R. Hancock, “Recovering Facial Shape Using a Statistical Model of Surface Normal Direction,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 28, no. 12, pp. 1914-1930, Dec. 2006.
[5] R. Basri and D. Jacobs, “Lambertian Reflectance and Linear Subspaces,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 25, no. 2, pp. 218-233, Feb. 2003.
[6] R. Ramamoorthi and P. Hanrahan, “On the Relationship between Radiance and Irradiance: Determining the Illumination from Images of Convex Lambertian Object,” J. Optical Soc. Am. A, pp.2448-2459, Oct. 2001.
[7] B.K.P. Horn and M.J. Brooks, Shape from Shading. MIT Press, 1989.
[8] R. Zhang, P. Tsai, J. Cryer, and M. Shah, “Shape from Shading: A Survey,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 21, no. 8, pp. 690-706, Aug. 1999.
[9] S. Biswas, G. Aggarwal, and R. Chellappa, “Robust Estimation of Albedo for Illumination-Invariant Matching and Shape Recovery,” Proc. IEEE 11th Int'l Conf. Computer Vision, 2007.
[10] W. Zhao and R. Chellappa, “Symmetric Shape from Shading Using Self-Ratio Image,” Int'l J. Computer Vision, vol. 45, no. 1, pp.55-75, Oct. 2001.
[11] J.J. Atick, P.A. Griffin, and A.N. Redlich, “Statistical Approach to SFS: Reconstruction of 3D Face Surfaces from Single 2D Images,” Neural Computation, vol. 8, pp. 1321-1340, Aug. 1996.
[12] R. Dovgard and R. Basri, “Statistical Symmetric Shape from Shading for 3D Structure Recovery of Faces,” Proc. Eighth European Conf. Computer Vision, pp. 99-113, 2004.
[13] D. Samaras and D. Metaxas, “Illumination Constraints in Deformable Models for Shape and Light Direction Estimation,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 25, no. 2, pp. 247-264, Feb. 2003.
[14] S. Zhou, R. Chellappa, and D. Jacobs, “Characterization of Human Faces under Illumination Variations Using Rank, Integrability, and Symmetry Constraints,” Proc. Eighth European Conf. Computer Vision, pp. 588-601, 2004.
[15] Z. Yue, W. Zhao, and R. Chellappa, “Pose-Encoded Spherical Harmonics for Face Recognition and Synthesis Using a Single Image,” EURASIP J. Advances in Signal Processing, 2008.
[16] K.C. Lee and B. Moghaddam, “A Practical Face Relighting Method for Directional Lighting Normalization,” Proc. Second Int'l Workshop Analysis and Modeling of Faces and Gestures, Oct. 2005.
[17] A. Hurlbert, “Formal Connections between Lightness Algorithms,” J. Optical Soc. Am. A, vol. 3, no. 10, pp. 1684-1693, Oct. 1986.
[18] H.C. Andrews and B.R. Hunt, Digital Image Restoration. Prentice-Hall Signal Processing Series, 1977.
[19] B.R. Hunt and T.M. Cannon, “Nonstationary Assumptions for Gaussian Models of Images,” IEEE Trans. Systems, Man, and Cybernetics, vol. 6, pp. 876-881, Dec. 1976.
[20] H.T. Trussell and B.R. Hunt, “Sectioned Methods for Image Restoration,” IEEE Trans. Acoustics, Speech, and Signal Processing, vol. 26, pp. 157-164, Apr. 1978.
[21] D.S. Lebedev and L.I. Mirkin, “Smoothing of Two-Dimensional Images Using the 'Composite' Model of a Fragment,” Iconics-Digital Holography-Image Processing, pp. 57-62, 1975.
[22] G.L. Anderson and A.N. Netravali, “Image Restoration Based on Subjective Criterion,” IEEE Trans. Systems, Man, and Cybernetics, vol. 6, pp. 845-853, Dec. 1976.
[23] J.F. Abramatic and L.M. Silverman, “Nonlinear Restoration of Noisy Images,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 4, pp. 141-149, Mar. 1982.
[24] F. Naderi and A.A. Sawchuk, “Estimation of Images Degraded by Film-Grain Noise,” Applied Optics, vol. 17, pp. 1228-1237, Apr. 1978.
[25] D.T. Kuan, A.A. Sawchuk, T.C. Strand, and P. Chavel, “Adaptive Noise Smoothing Filter for Images with Signal-Dependent Noise,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 7, no. 2, pp. 165-177, Mar. 1985.
[26] M.J. Brooks and B.K.P. Horn, “Shape and Source from Shading,” Proc. Ninth Int'l Joint Conf. Artificial Intelligence, pp. 932-936, Aug. 1985.
[27] A.P. Sage and J.L. Melsa, Estimation Theory with Applications to Communications and Control. McGraw-Hill, 1971.
[28] A.S. Georghiades, P.N. Belhumeur, and D.J. Kriegman, “From Few to Many: Illumination Cone Models for Face Recognition under Variable Lighting and Pose,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 23, no. 6, pp. 643-660, June 2001.
[29] P.S. Tsai and M. Shah, “Shape from Shading Using Linear Approximation,” Image and Vision Computing J., vol. 12, no. 8, pp. 487-498, Oct. 1994.
[30] T. Sim, S. Baker, and M. Bsat, “The CMU Pose, Illumination, and Expression Database,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 25, no. 12, pp. 1615-1618, Dec. 2003.
[31] P.J. Phillips, P.J. Flynn, T. Scruggs, K.W. Bowyer, J. Chang, K. Hoffman, J. Marques, J. Min, and W. Worek, “Overview of the Face Recognition Grand Challenge,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 947-954, 2005.
[32] G. Aggarwal and R. Chellappa, “Face Recognition in the Presence of Multiple Light Sources,” Proc. 10th Int'l Conf. Computer Vision, pp. 1169-1176, 2005.
[33] M. Savvides, B.V.K.V. Kumar, and P.K. Khosla, “Corefaces— Robust Shift Invariant PCA Based Correlation Filter for Illumination Tolerant Face Recognition,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. II: 834-II: 841, 2004.
[34] C.T. Yang, S. Lai, and L. Chang, “Robust Face Image Matching under Illumination Variations,” EURASIP J. Applied Signal Processing, vol. 2004, no. 16, pp. 2533-2543, 2004.
[35] K.C. Lee, J. Ho, and D. Kriegman, “Nine Points of Light: Acquiring Subspaces for Face Recognition under Variable Lighting,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp.519-526, Dec. 2001.
[36] J.M. Geusebroek, G.J. Burghouts, and A.W.M. Smeulders, “The Amsterdam Library of Object Images,” Int'l J. Computer Vision, vol. 61, no. 1, pp. 103-112, Jan. 2005.
17 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool