This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Total Variation Models for Variable Lighting Face Recognition
September 2006 (vol. 28 no. 9)
pp. 1519-1524
Xiang Sean Zhou, IEEE Computer Society
In this paper, we present the logarithmic total variation (LTV) model for face recognition under varying illumination, including natural lighting conditions, where we rarely know the strength, direction, or number of light sources. The proposed LTV model has the ability to factorize a single face image and obtain the illumination invariant facial structure, which is then used for face recognition. Our model is inspired by the SQI model but has better edge-preserving ability and simpler parameter selection. The merit of this model is that neither does it require any lighting assumption nor does it need any training. The LTV model reaches very high recognition rates in the tests using both Yale and CMU PIE face databases as well as a face database containing 765 subjects under outdoor lighting conditions.

[1] Y. Adini, Y. Moses, and S. Ullman, “Face Recognition: The Problem of Compensating for Changes in Illumination Direction,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 19, no. 7, pp. 721-732, July 1997.
[2] F. Alizadeh and D. Goldfarb, “Second-Order Cone Programming,” Math. Programming, vol. 95, no. 1, pp. 3-51, 2003.
[3] S. Alliney, “Digital Filters as Absolute Norm Regularizers,” IEEE Trans. Signal Processing, vol. 40, pp. 1548-1562, 1992.
[4] R. Basri and D. Jacobs, “Lambertian Reflectance and Linear Subspaces,” Technical Report 2000-172R, NEC Research Inst., 2000.
[5] P.N. Belhumeur, J.P. Hespanha, and D.J. Kriegman, “Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 20, no. 7, July 1997.
[6] P.N. Belhumeur and D.J. Kriegman, “What Is the Set of Images of an Object under All Possible Lighting Conditions?” IEEE Int'l Conf. Computer Vision and Pattern Recognition, 1996.
[7] V. Brajovic, “A Model for Reflectance Perception in Vision,” Proc. SPIE Bioengineered and Bioinspired Systems, vol. 5119, 2003.
[8] V. Brajovic, “Brightness Perception, Dynamic Range and Noise: A Unifying Model for Adaptive Image Sensors,” IEEE Int'l Conf. Computer Vision and Pattern Recognition, 2004.
[9] T.F. Chan and S. Esedoglu, “Aspects of Total Variation Regularized $L^1$ Function Approximation,” CAM Report 04-07, Univ. of California, Los Angeles, Feb. 2004.
[10] T. Chen, W. Yin, X.-S. Zhou, D. Comaniciu, and T.S. Huang, “Illumination Normalization for Face Recognition and Uneven Background Correction Using Total Variation Based Image Models,” Proc. IEEE Int'l Conf. Computer Vision and Pattern Recognition, 2005.
[11] D. Comaniciu and P. Meer, “Mean Shift: A Robust Approach toward Feature Space Analysis,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 24, no. 5, pp. 603-619, May 2002.
[12] F. Durand and J. Dorsey, “Fast Bilateral Filtering for the Display of High-Dynamic-Range Images,” ACM Trans. Graphics, vol. 21, no. 3, 2002.
[13] M. Elad, R. Kimmel, D. Shaked, and R. Keshet, “Reduced Complexity Retinex Algorithm via the Variational Approach,” J. Visual Comm. and Image Representation, vol. 14, no. 4, pp. 369-388, 2003.
[14] A.S. Georghiades, P.N. Belhumeur, and D.J. Kriegman, “From Few to Many: Illumination Cone Models for Face Recognition under Differing Pose and Lighting,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 23, no. 6, pp. 643-660, June 2001.
[15] D. Goldfarb and W. Yin, “Second-Order Cone Programming Methods for Total Variation-Based Image Restoration,” Columbia CORC TR-2004-05, May 2004.
[16] R. Gross and V. Brajovic, “An Image Preprocessing Algorithm for Illumination Invariant Face Recognition,” Proc. Fourth Int'l Conf. Audio and Video Based Biometric Person Authentication, pp. 10-18, 2003.
[17] G. Guo, S.Z. Li, and K. Chan, “Face Recognition by Support Vector Machines,” Proc. Int'l Conf. Automatic Face and Gesture Recognition, pp. 196-201, 2000.
[18] B.K.P. Horn, “Determining Lightness from an Image,” Computer Graphics and Image Processing, vol. 3, no. 1, pp. 277-299, 1974.
[19] B.K.P. Horn, Robot Vision. MIT Press, 1986.
[20] D.J. Jobson, Z. Rahman, and G.A. Woodell, “A Multi-Scale Retinex for Bridging the Gap between Color Images and the Human Observation of Scenes,” IEEE Trans. Image Processing, vol. 6, no. 7, pp. 965-976, 1997.
[21] R. Kimmel, M. Elad, D. Shaked, R. Keshet, and I. Sobel, “A Variational Framework to Retinex,” Int'l J. Computer Vision, vol. 52, no. 1, pp. 7-23, 2003.
[22] E.H. Land and J.J. McCann, “Lightness and Retinex Theory,” J. Optical Soc. Am., vol. 61, no. 1, pp. 1-11, 1971.
[23] A. Lanitis, C.J. Taylor, and T.F. Cootes, “Automatic Interpretation and Coding of Face Images Using Flexible Models,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 19, no. 7, pp. 743-756, July 1997.
[24] K.-C. Lee, J. Ho, and D. Kriegman, “Nine Points of Light: Acquiring Subspaces for Face Recognition under Variable Lighting,” Proc. IEEE Int'l Conf. Computer Vision and Pattern Recognition, 2001.
[25] B. Moghaddam, T. Jebara, and A. Pentland, “Bayesian Face Recogntion,” Pattern Recognition, vol. 33, 2000.
[26] M. Nikolova, “Minimizers of Cost-Functions Involving Nonsmooth Data-Fidelity Terms” SIAM J. Numerical Analysis, vol. 40, no. 3, pp. 965-994, 2002.
[27] P. Oenev and J. Atick, “Local Feature Analysis: A General Statistical Theory for Object Reperesentation,” Network: Computation in Neural System, vol. 7, pp. 477-500, 1996.
[28] P. Perona and J. Malik, “Scale-Space and Edge Detection Using Anisotropic Diffusion,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 12, no. 7, pp. 629-639, July 1990.
[29] R. Ramamoorthi and P. Hanrahan, “On the Relationship between Radiance and Irradiance: Determining the Illumination from Images of a Convex Lambertian Object,” J. Optical Soc. Am. , vol. 18, no. 10, pp. 2448-2459, 2001.
[30] R. Rammamorthi and P. Hanrahan, “A Signal-Processing Framework for Inverse Rendering,” Proc. ACM SIGGRAPH, 2001.
[31] L. Rudin, S. Osher, and E. Fatemi, “Nonlinear Total Variation Based Noise Removal Algorithms,” Physica D, vol. 60, pp. 259-268, 1992.
[32] M. Savvides, B.V.K. Vijaya Kumar, and P.L. Khosla, “Corefaces— Robust Shift Invariant PCA Based Correlation Filter for Illumination Tolerant Face Recognition,” Proc. Int'l Conf. Computer Vision and Pattern Recognition, 2004.
[33] O. Scherzer, W. Yin, and S. Osher, “Slope and G-Value Characterization of Set-Valued Functions and Applications to Non-Differentiable Optimization Problems,” CAM Report 05-35, Univ. of California, Los Angeles, 2005.
[34] S. Shan, W. Gao, B. Cao, and D. Zhao, “Illumination Normalization for Robust Face Recognition against Varying Lighting Conditions,” Proc. Int'l Workshop Analysis and Modeling of Faces and Gestures, 2003.
[35] A. Shashua and T. Riklin-Raviv, “The Quotient Image: Class-Based Re-Rendering and Recognition with Varying Illuminations,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 23, no. 2, pp. 129-139, Feb. 2001.
[36] J. Short, J. Kittler, and K. Messer, “A Comparison of Photometric Normalisation Algorithms for Face Verification,” Proc. IEEE Int'l Conf. Automatic Face and Gesture Recognition, 2004.
[37] T. Sim, S. Baker, and M. Bsat, “The CMU Pose, Illumination, and Expression (PIE) Database,” Proc. IEEE Int'l Conf. Automatic Face and Gesture Recognition, May 2002.
[38] T.G. StockhamJr., “Image Processing in the Context of a Visual Model,” Proc. IEEE, vol. 60, 1972.
[39] D. Strong and T. Chan, “Edge-Preserving and Scale-Dependent Properties of Total Variation Regularization,” Inverse Problems, vol. 19, pp. S165-S187, 2003.
[40] C. Tomasi and R. Manduchi, “Bilateral Filtering for Gray and Color Images,” Proc. Int'l Conf. Computer Vision, 1998.
[41] J. Tumblin and G. Turk, “LCIS: A Boundary Hierarchy for Detail-Preserving Contrast Reduction,” Proc. ACM SIGGRAPH, 1999.
[42] M. Turk and A. Pentland, “Eigenfaces for Recogntion,” J. Cognitive Neuroscience, vol. 3, no. 1, pp. 71-86, 1991.
[43] H. Wang, S.Z. Li, and Y. Wang, “Generalized Quotient Image,” Proc. Int'l Conf. Computer Vision and Pattern Recognition, 2004.
[44] H. Wang, S.Z. Li, and Y. Wang, “Face Recognition under Varying Lighting Conditions Using Self Quotient Image,” Proc. IEEE Int'l Conf. Automatic Face and Gesture Recognition, 2004.
[45] L. Wiskott, J.M. Fellous, N. Kruger, and C.V.D. Malsburg, “Face Recogntion by Elastic Bunch Graph Matching,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 19, no. 7, pp. 775-779, July 1997.
[46] W. Yin, D. Goldfarb, and S. Osher, “Image Cartoon-Texture Decomposition and Feature Selection Using the Total Variation Regularized $L^1$ Functional,” Proc. Third Int'l Workshop Variational, Geometric, and Level Set Methods in Computer Vision, pp. 73-84, 2005.
[47] L. Zhang and D. Samaras, “Face Recognition under Variable Lighting Using Harmonic Image Exemplars,” Proc. Int'l Conf. Computer Vision and Pattern Recognition, 2003.
[48] W. Zhao and R. Chellappa, “Robust Face Recognition Using Symmetric Shape-from-Shading,” technical report, Center for Automation Research, Univ. of Maryland, 1999.
[49] W. Zhao and R. Chellappa, “Robust Image-Based 3D Face Recognition,” CAR-TR-932, N00014-95-1-0521, CS-TR-4091, Center for Auto Research, Univ. of Maryland, 2000.

Index Terms:
Face and gesture recognition, signal processing, image processing and computer vision, pattern analysis.
Citation:
Terrence Chen, Wotao Yin, Xiang Sean Zhou, Dorin Comaniciu, Thomas S. Huang, "Total Variation Models for Variable Lighting Face Recognition," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 28, no. 9, pp. 1519-1524, Sept. 2006, doi:10.1109/TPAMI.2006.195
Usage of this product signifies your acceptance of the Terms of Use.