This Article 
 Bibliographic References 
 Add to: 
Face Description with Local Binary Patterns: Application to Face Recognition
December 2006 (vol. 28 no. 12)
pp. 2037-2041
This paper presents a novel and efficient facial image representation based on local binary pattern (LBP) texture features. The face image is divided into several regions from which the LBP feature distributions are extracted and concatenated into an enhanced feature vector to be used as a face descriptor. The performance of the proposed method is assessed in the face recognition problem under different challenges. Other applications and several extensions are also discussed.

[1] Handbook of Face Recognition, S.Z. Li and A.K. Jain, eds. Springer, 2005.
[2] M. Turk and A. Pentland, “Eigenfaces for Recognition,” J. Cognitive Neuroscience, vol. 3, no. 1, pp. 71-86, 1991.
[3] K. Etemad and R. Chellappa, “Discriminant Analysis for Recognition of Human Face Images,” J. Optical Soc. Am., vol. 14, pp. 1724-1733, 1997.
[4] J. Yang, D. Zhang, A.F. Frangi, and J. Yang, “Two-dimensional PCA: A New Approach to Appearance-Based Face Representation and Recognition,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 26, no. 1, pp.131-137, Jan 2004.
[5] A. Pentland, B. Moghaddam, and T. Starner, “View-Based and Modular Eigenspaces for Face Recognition,” Proc. IEEE CS Conf. Computer Vision and Pattern Recognition, pp. 84-91, 1994.
[6] P.S. Penev and J.J. Atick, “Local Feature Analysis: A General Statistical Theory for Object Representation,” Network-Computation in Neural Systems, vol. 7, no. 3, pp. 477-500, Aug. 1996.
[7] L. Wiskott, J.-M. Fellous, N. Kuiger, and C. von der Malsburg, “Face Recognition by Elastic Bunch Graph Matching,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 19, pp. 775-779, 1997.
[8] B. Heisele, P. Ho, J. Wu, and T. Poggio, “Face Recognition: Component-Based versus Global Approaches,” Compter Vision and Image Understanding, vol. 91, nos. 1-2, pp. 6-21, 2003.
[9] K. Mikolajczyk and C. Schmid, “A Performance Evaluation of Local Descriptors,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 27, no. 10, pp. 1615-1630, Oct. 2005.
[10] T. Ahonen, A. Hadid, and M. Pietikäinen, “Face Recognition with Local Binary Patterns,” Proc. Eighth European Conf. Computer Vision, pp. 469-481, 2004.
[11] T. Ojala, M. Pietikäinen, and D. Harwood, “A Comparative Study of Texture Measures with Classification Based on Feature Distributions,” Pattern Recognition, vol. 29, no. 1, pp. 51-59, 1996.
[12] T. Ojala, M. Pietikäinen, and T. Mäenpää, “Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 24, no. 7, pp. 971-987, July 2002.
[13] R. Gottumukkal and V.K. Asari, “An Improved Face Recognition Technique Based on Modular PCA Approach,” Pattern Recognition Letters, vol. 25, pp. 429-436, Mar. 2004.
[14] W. Zhao, R. Chellappa, P.J. Phillips, and A. Rosenfeld, “Face Recognition: A Literature Survey,” ACM Computing Surveys, vol. 35, no. 4, pp. 399-458, Dec. 2003.
[15] J.R. Beveridge, D. Bolme, B.A. Draper, and M. Teixeira, “The CSU Face Identification Evaluation System: Its Purpose, Features, and Structure,” Machine Vision and Applications, vol. 16, no. 2, pp. 128-138, Feb. 2005.
[16] P.J. Phillips, H. Wechsler, J. Huang, and P. Rauss, “The FERET Database and Evaluation Procedure for Face Recognition Algorithms,” Image and Vision Computing, vol. 16, no. 10, pp. 295-306, Apr. 1998.
[17] B. Moghaddam, C. Nastar, and A. Pentland, “A Bayesian Similarity Measure for Direct Image Matching,” Proc. 13th Int'l Conf. Pattern Recognition, pp. II: 350-358, 1996.
[18] P.J. Phillips, H. Moon, S.A. Rizvi, and P.J. Rauss, “The FERET Evaluation Methodology for Face Recognition Algorithms,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 22, no. 10, pp. 1090-1104, Oct. 2000.
[19] B.S. Manjunath, J.-R. Ohm, V.V. Vasudevan, and A. Yamada, “Color and Texture Descriptors,” IEEE Trans. Circuits and Systems for Video Technology, vol. 11, no. 6, pp. 703-715, June 2001.
[20] M. Varma and A. Zisserman, “Texture Classification: Are Filter Banks Necessary?” Proc. IEEE CS Conf. Computer Vision and Pattern Recognition, pp.691-698, 2003.
[21] T. Ahonen, M. Pietikäinen, A. Hadid, and T. Mäenpää, “Face Recognition Based on Appearance of Local Regions,” Proc. 17th Int'l Conf. Pattern Recognition, pp. III: 153-156, 2004.
[22] A. Hadid, M. Pietikäinen, and T. Ahonen, “A Discriminative Feature Space for Detecting and Recognizing Faces,” Proc. IEEE CS Conf. Computer Vision and Pattern Recognition, vol. 2, pp. 797-804, 2004.
[23] X. Feng, M. Pietikäinen, and A. Hadid, “Facial Expression Recognition with Local Binary Patterns and Linear Programming,” Pattern Recognition and Image Analysis, vol. 15, no. 2, pp. 546-548, 2005.
[24] C. Shan, S. Gong, and P.W. McOwan, “Robust Facial Expression Recognition Using Local Binary Patterns,” Proc. IEEE Int'l Conf. Image Processing, pp. II: 914-917, 2005.
[25] G. Zhang, X. Huang, S.Z. Li, Y. Wang, and X. Wu, “Boosting Local Binary Pattern (LBP)-Based Face Recognition,” Proc. Advances in Biometric Person Authentication, pp. 179-186, 2004.
[26] S.Z. Li, R. Chu, M. Ao, L. Zhang, and R. He, “Highly Accurate and Fast Face Recognition Using Near Infrared Images,” Proc. Int'l Conf. Advances in Biometrics, pp. 151-158, 2006.
[27] W. Zhang, S. Shan, W. Gao, X. Chen, and H. Zhang, “Local Gabor Binary Pattern Histogram Sequence (LGBPHS): A Novel Non-Statistical Model for Face Representation and Recognition,” Proc. IEEE Int'l Conf. Computer Vision, pp. I: 786-791, 2005.
[28] Y. Rodriguez and S. Marcel, “Face Authentication Using Adapted Local Binary Pattern Histograms,” Proc. Ninth European Conf. Computer Vision, pp.IV: 321-332, 2006.

Index Terms:
Facial image representation, local binary pattern, component-based face recognition, texture features, face misalignment.
Timo Ahonen, Abdenour Hadid, Matti Pietik?inen, "Face Description with Local Binary Patterns: Application to Face Recognition," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 28, no. 12, pp. 2037-2041, Dec. 2006, doi:10.1109/TPAMI.2006.244
Usage of this product signifies your acceptance of the Terms of Use.