This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
A Blur-Robust Descriptor with Applications to Face Recognition
June 2012 (vol. 34 no. 6)
pp. 1220-1226
ASCII Text
x 
 
S. Taheri, R. Gopalan, P. Turaga, R. Chellappa, "A Blur-Robust Descriptor with Applications to Face Recognition," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 34, no. 6, pp. 1220-1226, June, 2012.
 
 
BibTex
x
 
@article{ 10.1109/TPAMI.2012.15,
author = {S. Taheri and R. Gopalan and P. Turaga and R. Chellappa},
title = {A Blur-Robust Descriptor with Applications to Face Recognition},
journal ={IEEE Transactions on Pattern Analysis and Machine Intelligence},
volume = {34},
number = {6},
issn = {0162-8828},
year = {2012},
pages = {1220-1226},
doi = {http://doi.ieeecomputersociety.org/10.1109/TPAMI.2012.15},
publisher = {IEEE Computer Society},
address = {Los Alamitos, CA, USA},
}
 
 
RefWorks Procite/RefMan/Endnote
x 
 
TY - JOUR
JO - IEEE Transactions on Pattern Analysis and Machine Intelligence
TI - A Blur-Robust Descriptor with Applications to Face Recognition
IS - 6
SN - 0162-8828
SP1220
EP1226
EPD - 1220-1226
A1 - S. Taheri,
A1 - R. Gopalan,
A1 - P. Turaga,
A1 - R. Chellappa,
PY - 2012
KW - image restoration
KW - convolution
KW - differential geometry
KW - face recognition
KW - probe images
KW - blur-robust descriptor
KW - face recognition
KW - blur effect
KW - visual analysis
KW - image-based recognition
KW - image-formation models
KW - differential geometric tools
KW - image blurring
KW - image convolution
KW - orthonormal basis functions
KW - zero noise
KW - blur kernel property
KW - subspace representation
KW - Grassmann manifold
KW - facial variations
KW - gallery images
KW - Kernel
KW - Noise
KW - Face
KW - Face recognition
KW - Manifolds
KW - Probes
KW - Convolution
KW - face recognition.
KW - Blur
KW - convolution
KW - subspace
KW - Grassmann manifold
VL - 34
JA - IEEE Transactions on Pattern Analysis and Machine Intelligence
ER -
 
S. Taheri, Dept. of Comput. Sci., Univ. of Maryland, College Park, MD, USA
R. Gopalan, Video & Multimedia Dept., AT&T Labs. - Res., Middletown, NJ, USA
P. Turaga, Schools of Arts, Media, Eng., & Electr. Eng., Arizona State Univ., Tempe, AZ, USA
R. Chellappa, Dept. of Electr. & Comput. Eng., Univ. of Maryland, College Park, MD, USA
Understanding the effect of blur is an important problem in unconstrained visual analysis. We address this problem in the context of image-based recognition by a fusion of image-formation models and differential geometric tools. First, we discuss the space spanned by blurred versions of an image and then, under certain assumptions, provide a differential geometric analysis of that space. More specifically, we create a subspace resulting from convolution of an image with a complete set of orthonormal basis functions of a prespecified maximum size (that can represent an arbitrary blur kernel within that size), and show that the corresponding subspaces created from a clean image and its blurred versions are equal under the ideal case of zero noise and some assumptions on the properties of blur kernels. We then study the practical utility of this subspace representation for the problem of direct recognition of blurred faces by viewing the subspaces as points on the Grassmann manifold and present methods to perform recognition for cases where the blur is both homogenous and spatially varying. We empirically analyze the effect of noise, as well as the presence of other facial variations between the gallery and probe images, and provide comparisons with existing approaches on standard data sets.

[1] P.-A. Absil, R. Mahony, and R. Sepulchre, "Riemannian Geometry of Grassmann Manifolds with a View on Algorithmic Computation," Acta Applicandae Math., vol. 80, pp. 199-220, Feb. 2004.
[2] A. Agrawal and Y. Xu, "Coded Exposure Deblurring: Optimized Codes for PSF Estimation and Invertibility," Proc. IEEE CS Conf. Computer Vision and Pattern Recognition, pp. 2066-2073, June 2009.
[3] T. Ahonen, E. Rahtu, V. Ojansivu, and J. Heikkila, "Recognition of Blurred Faces Using Local Phase Quantization," Proc. Int'l Conf. Pattern Recognition, pp. 1-4, Dec. 2008.
[4] H. Andrews and B. Hunt, Digital Image Restoration. Prentice Hall Signal Processing Series, 1977.
[5] E. Begelfor and M. Werman, "Affine Invariance Revisited," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 2087-2094, June 2006.
[6] A. Chakrabarti, T. Zickler, and W. Freeman, "Analyzing Spatially-Varying Blur," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 2512-1519, June 2010.
[7] Y. Chikuse, Statistics on Special Manifolds. Springer Verlag, 2003.
[8] A. Edelman, T. Arias, and S. Smith, "The Geometry of Algorithms with Orthogonality Constraints," SIAM J. Matrix Analysis and Applications, vol. 20, pp. 303-353, Apr. 1999.
[9] R. Fergus, B. Singh, A. Hertzmann, S.T. Roweis, and W.T. Freeman, "Removing Camera Shake from a Single Photograph," ACM Trans. Graphics, vol. 25, pp. 787-794, Mar. 2006.
[10] J. Flusser, J. Boldys, and B. Zitová, "Moment Forms Invariant to Rotation and Blur in Arbitrary Number of Dimensions," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 25, no. 2, pp. 234-246, Feb. 2003.
[11] J. Flusser, J. Boldyš, and B. Zitová, "Invariants to Convolution in Arbitrary Dimensions," J. Math. Imaging and Vision, vol. 13, pp. 101-113, Feb. 2000.
[12] J. Flusser and T. Suk, "Degraded Image Analysis: An Invariant Approach," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 20, no. 6, pp. 590-603, June 1998.
[13] J. Flusser, T. Suk, and S. Saic, "Recognition of Images Degraded by Linear Motion Blur without Restoration," Proc. Theoretical Foundations of Computer Vision, pp. 37-51, Sept. 1996.
[14] K. Gallivan, A. Srivastava, X. Liu, and P. Van Dooren, "Efficient Algorithms for Inferences on Grassmann Manifolds," Proc. IEEE Workshop Statistical Signal Processing, pp. 315-318, Feb. 2003.
[15] J. Hamm and D.D. Lee, "Grassmann Discriminant Analysis: A Unifying View on Subspace-Based Learning," Proc. Int'l Conf. Machine Learning, pp. 376-383, July 2008.
[16] P.C. Hansen, J.G. Nagy, and D.P. O'Leary, Deblurring Images: Matrices, Spectra, and Filtering. SIAM, 2006.
[17] H. Hu and G. de Haan, "Low Cost Robust Blur Estimator," Proc. Int'l Conf. Image Processing, pp. 617-620, Oct. 2006.
[18] K. Lee, J. Ho, and D. Kriegman, "Acquiring Linear Subspaces for Face Recognition under Variable Lighting," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 27, no. 5, pp. 684-698, May 2005.
[19] A. Levin, D. Lischinski, and Y. Weiss, "A Closed-Form Solution to Natural Image Matting," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 30, no. 2, pp. 228-242, Feb. 2008.
[20] A. Levin, Y. Weiss, F. Durand, and W. Freeman, "Efficient Marginal Likelihood Optimization in Blind Deconvolution," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 2657-2664, June 2011.
[21] Y.M. Lui and J.R. Beveridge, "Grassmann Registration Manifolds for Face Recognition," Proc. 10th European Conf. Computer Vision, pp. 44-57, Oct. 2008.
[22] M. Nishiyama, A. Hadid, H. Takeshima, J. Shotton, T. Kozakaya, and O. Yamaguchi, "Facial Deblur Inference Using Subspace Analysis for Recognition of Blurred Faces," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 33, no. 4, pp. 838-845, Apr. 2011.
[23] M. Nishiyama, H. Takeshima, J. Shotton, T. Kozakaya, and O. Yamaguchi, "Facial Deblur Inference to Improve Recognition of Blurred Faces," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 1115-1122, June 2009.
[24] V. Ojansivu and J. Heikkilä, "A Method for Blur and Affine Invariant Object Recognition Using Phase-Only Bispectrum," Proc. Int'l Conf. Image Analysis and Recognition, pp. 527-536, June 2008.
[25] P. Phillips, P. Flynn, T. Scruggs, K. Bowyer, J. Chang, K. Hoffman, J. Marques, J. Min, and W. Worek, "Overview of the Face Recognition Grand Challenge," Proc. IEEE CS Conf. Computer Vision and Pattern Recognition, pp. 947-954, June 2005.
[26] P. Phillips, H. Moon, S. Rizvi, and P. Rauss, "The FERET Evaluation Methodology for Face-Recognition Algorithms," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 22, no. 10, pp. 1090-1104, Oct. 2000.
[27] L.I. Rudin, S. Osher, and E. Fatemi, "Nonlinear Total Variation Based Noise Removal Algorithms," Physica D, vol. 60, pp. 259-268, Nov. 1992.
[28] T. Sim, S. Baker, and M. Bsat, "The CMU Pose, Illumination, and Expression Database," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 25, no. 12, pp. 1615-1618, Dec. 2003.
[29] I. Stainvas and N. Intrator, "Blurred Face Recognition via a Hybrid Network Architecture," Proc. Int'l Conf. Pattern Recognition, pp. 805-808, Sept. 2000.
[30] T. Suk and J. Flusser, "Combined Blur and Affine Moment Invariants and Their Use in Pattern Recognition," Pattern Recognition, vol. 36, pp. 2895-2907, Dec. 2003.
[31] A.N. Tikhonov and V.Y. Arsenin, Solutions of Ill-Posed Problems. Winston, 1977.
[32] P. Turaga, A. Veeraraghavan, A. Srivastava, and R. Chellappa, "Statistical Computations on Grassmann and Stiefel Manifolds for Image and Video-Based Recognition," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 33, no. 11, pp. 2273-2286, Nov. 2011.
[33] Y. Wong, "Differential Geometry of Grassmann Manifolds," Proc. Nat'l Academy of Science, vol. 57, pp. 589-594, 1967.
[34] L. Yuan, J. Sun, L. Quan, and H.-Y. Shum, "Progressive Inter-Scale and Intra-Scale Non-Blind Image Deconvolution," ACM Trans. Graphics, vol. 27, pp. 1-10, Mar. 2008.

Index Terms:
image restoration,convolution,differential geometry,face recognition,probe images,blur-robust descriptor,face recognition,blur effect,visual analysis,image-based recognition,image-formation models,differential geometric tools,image blurring,image convolution,orthonormal basis functions,zero noise,blur kernel property,subspace representation,Grassmann manifold,facial variations,gallery images,Kernel,Noise,Face,Face recognition,Manifolds,Probes,Convolution,face recognition.,Blur,convolution,subspace,Grassmann manifold
Citation:
S. Taheri, R. Gopalan, P. Turaga, R. Chellappa, "A Blur-Robust Descriptor with Applications to Face Recognition," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 34, no. 6, pp. 1220-1226, June 2012, doi:10.1109/TPAMI.2012.15
Usage of this product signifies your acceptance of the Terms of Use.