This Article 
 Bibliographic References 
 Add to: 
Facial Deblur Inference Using Subspace Analysis for Recognition of Blurred Faces
April 2011 (vol. 33 no. 4)
pp. 838-845
Masashi Nishiyama, Toshiba Corporation, Kawasaki
Abdenour Hadid, University of Oulu, Oulu
Hidenori Takeshima, Toshiba Corporation, Kawasaki
Jamie Shotton, Microsoft Research Cambridge, Cambridge
Tatsuo Kozakaya, Toshiba Corporation, Kawasaki
Osamu Yamaguchi, Toshiba Corporation, Tokyo
This paper proposes a novel method for recognizing faces degraded by blur using deblurring of facial images. The main issue is how to infer a Point Spread Function (PSF) representing the process of blur on faces. Inferring a PSF from a single facial image is an ill-posed problem. Our method uses learned prior information derived from a training set of blurred faces to make the problem more tractable. We construct a feature space such that blurred faces degraded by the same PSF are similar to one another. We learn statistical models that represent prior knowledge of predefined PSF sets in this feature space. A query image of unknown blur is compared with each model and the closest one is selected for PSF inference. The query image is deblurred using the PSF corresponding to that model and is thus ready for recognition. Experiments on a large face database (FERET) artificially degraded by focus or motion blur show that our method substantially improves the recognition performance compared to existing methods. We also demonstrate improved performance on real blurred images on the FRGC 1.0 face database. Furthermore, we show and explain how combining the proposed facial deblur inference with the local phase quantization (LPQ) method can further enhance the performance.

[1] S.Z. Li and A.K. Jain, Handbook of Face Recognition. Springer, 2005.
[2] T. Bourlai, A. Ross, and A.K. Jain, "On Matching Digital Face Images against Scanned Passport Photos," Proc. IEEE Int'l Conf. Biometrics, Identity, and Security, 2009.
[3] I. Stainvas and N. Intrator, "Blurred Face Recognition via a Hybrid Network Architecture," Proc. Int'l Conf. Pattern Recognition, vol. 2, pp. 805-808, 2000.
[4] D. Kundur and D. Hatzinakos, "Blind Image Deconvolution," IEEE Signal Processing Magazine, vol. 13, no. 3, pp. 43-64, May 1996.
[5] P. Campisi and K. Egiazarian, Blind Image Deconvolution: Theory and Applications. Taylor & Francis, 2007.
[6] T.F. Chan and C.-K. Wong, "Total Variation Blind Deconvolution," IEEE Trans. Image Processing, vol. 7, no. 3, pp. 370-375, Mar. 1998.
[7] H. Hu and G. de Haan, "Low Cost Robust Blur Estimator," Proc. IEEE Int'l Conf. Image Processing, pp. 617-620, 2006.
[8] J.H. Elder, "Local Scale Control for Edge Detection and Blur Estimation," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 20, no. 7, pp. 699-716, July 1998.
[9] F. Rooms, A. Pizurica, and W. Philips, "Estimating Image Blur in the Wavelet Domain," Proc. Fifth Asian Conf. Computer Vision, pp. 210-215, 2002.
[10] H. Tong, M. Li, H. Zhang, and C. Zhang, "Blur Detection for Digital Images Using Wavelet Transform," Proc. IEEE Int'l Conf. Multimedia and Expo, vol. 1, pp. 17-20, 2004.
[11] Y. Yitzhaky and N.S. Kopeika, "Identification of Blur Parameters from Motion Blurred Images," Graphical Models and Image Processing, vol. 59, no. 5, pp. 310-320, 1997.
[12] J. Jia, "Single Image Motion Deblurring Using Transparency," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 1-8, 2007.
[13] L. Yuan, J. Sun, L. Quan, and H.Y. Shum, "Image Deblurring with Blurred/Noisy Image Pairs," ACM Trans. Graphics, vol. 26, no. 3, pp. 1-10, 2007.
[14] C. Ancuti, C.O. Ancuti, and P. Bekaert, "Deblurring by Matching," Computer Graphics Forum, vol. 28, no. 2 pp. 619-628, 2009.
[15] R. Fergus, B. Singh, A. Hertzmann, S.T. Roweis, and W.T. Freeman, "Removing Camera Shake from a Single Photograph," ACM Trans. Graphics, vol. 25, no. 3, pp. 787-794, 2006.
[16] M. Nishiyama, H. Takeshima, J. Shotton, T. Kozakaya, and O. Yamaguchi, "Facial Deblur Inference to Improve Recognition of Blurred Faces," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 1115-1122, 2009.
[17] T. Ahonen, E. Rahtu, V. Ojansivu, and J. Heikkila, "Recognition of Blurred Faces Using Local Phase Quantization," Proc. Int'l Conf. Pattern Recognition, pp. 1-4, 2008.
[18] T. Mita, T. Kaneko, B. Stenger, and O. Hori, "Discriminative Feature Co-Occurrence Selection for Object Detection," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 30, no. 7, pp. 1257-1269, July 2008.
[19] A.E. Savakis and H.J. Trussell, "Blur Identification by Residual Spectral Matching," IEEE Trans. Image Processing, vol. 2, no. 2, pp. 141-151, Apr. 1993.
[20] S. Watanabe and N. Pakvasa, "Subspace Method of Pattern Recognition," Proc. Int'l Joint Conf. Pattern Recognition, pp. 25-32, 1973.
[21] R.C. Gonzalez and R.E. Woods, Digital Image Processing. Prentice Hall, 2007.
[22] M. Savvides, B.V.K.V. Kumar, and P.K. Khosla, "Eigenphases versus Eigenfaces," Proc. Int'l Conf. Pattern Recognition, vol. 3, pp. 810 -813, 2004.
[23] D.B. Gennery, "Determination of Optical Transfer Function by Inspection of the Frequency-Domain Plot," J. Optical Soc. Am., vol. 63, no. 12, pp. 1571-1577, 1973.
[24] M. Cannon, "Blind Deconvolution of Spatially Invariant Image Blurs with Phase," IEEE Trans. Acoustics, Speech, and Signal Processing, vol. 24, no. 1, pp. 58-63, Feb. 1976.
[25] M.M. Chang, A.M. Tekalp, and A.T. Erdem, "Blur Identification Using the Bispectrum," IEEE Trans. Signal Processing, vol. 39, no. 10, pp. 2323-2325, Oct. 1991.
[26] E. Oja, Subspace Methods of Pattern Recognition. Research Studies Press, 1983.
[27] S. Farsiu, M.D. Robinson, M. Elad, and P. Milanfar, "Fast and Robust Multiframe Super Resolution," IEEE Trans. Image Processing, vol. 13, no. 10, pp. 1327-1344, Oct. 2004.
[28] P.J. Phillips, H. Moon, P.J. Rauss, and S. Rizvi, "The Feret Evaluation Methodology for Face Recognition Algorithms," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 22, no. 10, pp. 1090-1104, Oct. 2000.
[29] P.J. Phillips, P.J. Flynn, T. Scruggs, K.W. Bowyer, J. Chang, K. Hoffman, J. Marques, J. Min, and W. Worek, "Overview of the Face Recognition Grand Challenge," Proc. IEEE Conf. Computer Vision and Pattern Recognition, vol. 1, pp. 947-954, 2005.
[30] T. Ahonen, A. Hadid, and M. Pietikainen, "Face Description with Local Binary Patterns: Application to Face Recognition," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 28, no. 12, pp. 2037-2041, Dec. 2006.
[31] M. Turk and A. Pentland, "Eigenfaces for Recognition," J. Cognitive Neurosicence, vol. 3, no. 1, pp. 71-86, 1991.
[32] X. He, S. Yan, Y. Hu, and P. Niyogi, "Face Recognition Using Laplacianfaces," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 27, no. 3, pp. 328-340, Mar. 2005.
[33] V. Ojansivu and J. Heikkila, "Blur Insensitive Texture Classification Using Local Phase Quantization," Proc. Third Int'l Conf. Image and Signal Processing, pp. 236-243, 2008.

Index Terms:
Face recognition, inference, point spread function, deblur.
Masashi Nishiyama, Abdenour Hadid, Hidenori Takeshima, Jamie Shotton, Tatsuo Kozakaya, Osamu Yamaguchi, "Facial Deblur Inference Using Subspace Analysis for Recognition of Blurred Faces," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 33, no. 4, pp. 838-845, April 2011, doi:10.1109/TPAMI.2010.203
Usage of this product signifies your acceptance of the Terms of Use.