The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.11 - Nov. (2012 vol.34)
pp: 2233-2246
Yigang Peng , Dept. of Autom., Tsinghua Univ., Beijing, China
A. Ganesh , Dept. of Electr. & Comput. Eng., Univ. of Illinois at Urbana-Champaign, Urbana, IL, USA
J. Wright , Dept. of Electr. Eng., Columbia Univ., New York, NY, USA
Wenli Xu , Dept. of Autom., Tsinghua Univ., Beijing, China
Yi Ma , Dept. of Electr. & Comput. Eng., Univ. of Illinois at Urbana-Champaign, Urbana, IL, USA
ABSTRACT
This paper studies the problem of simultaneously aligning a batch of linearly correlated images despite gross corruption (such as occlusion). Our method seeks an optimal set of image domain transformations such that the matrix of transformed images can be decomposed as the sum of a sparse matrix of errors and a low-rank matrix of recovered aligned images. We reduce this extremely challenging optimization problem to a sequence of convex programs that minimize the sum of ℓ1-norm and nuclear norm of the two component matrices, which can be efficiently solved by scalable convex optimization techniques. We verify the efficacy of the proposed robust alignment algorithm with extensive experiments on both controlled and uncontrolled real data, demonstrating higher accuracy and efficiency than existing methods over a wide range of realistic misalignments and corruptions.
INDEX TERMS
Robustness, Minimization, Algorithm design and analysis, Lighting, Optimization, Sparse matrices, Educational institutions, occlusion and corruption, Batch image alignment, low-rank matrix, sparse errors, robust principal component analysis
CITATION
Yigang Peng, A. Ganesh, J. Wright, Wenli Xu, Yi Ma, "RASL: Robust Alignment by Sparse and Low-Rank Decomposition for Linearly Correlated Images", IEEE Transactions on Pattern Analysis & Machine Intelligence, vol.34, no. 11, pp. 2233-2246, Nov. 2012, doi:10.1109/TPAMI.2011.282
REFERENCES
[1] G.B. Huang, M. Ramesh, T. Berg, and E. Learned-Miller, "Labeled Faces in the Wild: A Database for Studying Face Recognition in Unconstrained Environments," technical report, Univ. of Massachusetts, pp. 7-49, 2007.
[2] J.B.A. Maintz and M.A. Viergever, "A Survey of Medical Image Registration," Medical Image Analysis, vol. 2, no. 1, pp. 1-36, 1998.
[3] L.G. Brown, "A Survey of Image Registration Techniques," ACM Computing Surveys, vol. 24, no. 4, pp. 325-376, 1992.
[4] J.P.W. Pluim, J.B.A. Maintz, and M.A. Viergever, "Mutual-Information-Based Registration of Medical Images: A Survey," IEEE Trans. Medical Imaging, vol. 22, no. 8, pp. 986-1004, Aug. 2003.
[5] E. Learned-Miller, "Data Driven Image Models through Continuous Joint Alignment," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 28, no. 2, pp. 236-250, Feb. 2006.
[6] G.B. Huang, V. Jain, and E. Learned-Miller, "Unsupervised Joint Alignment of Complex Images," Proc. IEEE Int'l Conf. Computer Vision, 2007.
[7] M. Cox, S. Lucey, S. Sridharan, and J. Cohn, "Least Squares Congealing for Unsupervised Alignment of Images," Proc. IEEE Int'l Conf. Computer Vision and Pattern Recognition, 2008.
[8] M. Cox, S. Lucey, S. Sridharan, and J. Cohn, "Least-Squares Congealing for Large Numbers of Images," Proc. IEEE Int'l Conf. Computer Vision, 2009.
[9] A. Vedaldi, G. Guidi, and S. Soatto, "Joint Alignment Up to (Lossy) Transformations," Proc. IEEE Int'l Conf. Computer Vision and Pattern Recognition, 2008.
[10] M. Fazel, H. Hindi, and S. Boyd, "Log-Det Heuristic for Matrix Rank Minimization with Applications to Hankel and Euclidean Distance Matrices," Proc. Am. Control Conf., 2003.
[11] B. Frey and N. Jojic, "Transformed Component Analysis: Joint Estimation of Spatial Transformations and Image Components," Proc. IEEE Int'l Conf. Computer Vision, 1999.
[12] B.J. Frey and N. Jojic, "Transformation-Invariant Clustering Using the EM Algorithm," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 25, no. 1, pp. 1-17, 2003.
[13] F. de la Torre and M. Black, "Robust Parameterized Component Analysis: Theory and Applications to 2D Facial Appearance Models," Computer Vision and Image Understanding, vol. 91, nos. 1/2, pp. 53-71, 2003.
[14] F. de la Torre and M.J. Black, "A Framework for Robust Subspace Learning," Int'l J. Computer Vision, vol. 54, nos. 1-3, pp. 117-142, 2003.
[15] V. Chandrasekaran, S. Sanghavi, P. Parrilo, and A. Willsky, "Rank-Sparsity Incoherence for Matrix Decomposition," SIAM J. Optimization, vol. 21, no. 2, pp. 572-596, 2011.
[16] E. Candès, X. Li, Y. Ma, and J. Wright, "Robust Principal Component Analysis?" J. ACM, vol. 58, no. 3, pp. 1-37, 2011.
[17] R. Basri and D. Jacobs, "Lambertian Reflectance and Linear Subspaces," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 25, no. 2, pp. 218-233, Feb. 2003.
[18] Y. Ma, S. Soatto, J. Košecká, and S.S. Sastry, An Invitation to 3-D Vision. Springer, 2004.
[19] J. Wright, A. Yang, A. Ganesh, S.S. Sastry, and Y. Ma, "Robust Face Recognition via Sparse Representation," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 31, no. 2, pp. 210-227, Feb. 2009.
[20] S. Baker and I. Matthews, "Lucas-Kanade 20 Years On: A Unifying Framework," Int'l J. Computer Vision, vol. 56, pp. 221-255, 2004.
[21] A. Wagner, J. Wright, A. Ganesh, Z. Zhou, and Y. Ma, "Towards a Practical Face Recognition System: Robust Registration and Illumination by Sparse Representation," Proc. IEEE Int'l Conf. Computer Vision and Pattern Recognition, 2009.
[22] Z. Zhou, X. Li, J. Wright, E. Candes, and Y. Ma, "Stable Principal Component Pursuit," Proc. Int'l Symp. Information Theory, 2010.
[23] A. Lewis and S. Wright, "A Proximal Method for Composite Minimization," technical report, Univ. of Wisconsin, 2008.
[24] K. Jittorntrum and M. Osborne, "Strong Uniqueness and Second Order Convergence in Nonlinear Discrete Approximation," Numerische Mathematik, vol. 34, pp. 439-455, 1980.
[25] L. Cromme, "Strong Uniqueness: A Far-Reaching Criterion for the Convergence Analysis of Iterative Procedures," Numerishe Mathematik, vol. 29, pp. 179-193, 1978.
[26] D. Donoho and C. Grimes, "Image Manifolds Which Are Isometric to Euclidean Space," J. Math. Imaging and Vision, vol. 23, no. 1, pp. 5-24, 2005.
[27] K. Toh and S. Yun, "An Accelerated Proximal Gradient Algorithms for Nuclear Norm Regularized Least Squares Problems," Pacific J. Optimization, vol. 6, pp. 615-640, 2010.
[28] A. Ganesh, Z. Lin, J. Wright, L. Wu, M. Chen, and Y. Ma, "Fast Algorithms for Recovering a Corrupted Low-Rank Matrix," Proc. Computational Advances in Multi-Sensor Adaptive Processing, Dec. 2009.
[29] Z. Lin, M. Chen, L. Wu, and Y. Ma, "The Augmented Lagrange Multiplier Method for Exact Recovery of Corrupted Low-Rank Matrices," Technical Report UILU-ENG-09-2215, Univ. of Illinois at Urbana-Champaign, 2009.
[30] D.P. Bertsekas, Nonlinear Programming. Athena Scientific, 2004.
[31] Y. Peng, A. Ganesh, J. Wright, W. Xu, and Y. Ma, "RASL: Robust Alignment via Sparse and Low-Rank Decomposition for Linearly Correlated Images," Proc. IEEE Int'l Conf. Computer Vision and Pattern Recognition, 2010.
[32] R. Glowinski and A. Marroco, "Sur l'Approximation, par Elements Finis d'Ordre Un, et la Resolution, par Penalisation-Dualite, d'une Classe de Problemes de Dirichlet Non Lineares," Rev. Francaise d'Automatique, Informatique et Recherche Operationelle, vol. 9, pp. 41-76, 1975.
[33] D. Gabay and B. Mercier, "A Dual Algorithm for the Solution of Nonlinear Variational Problems via Finite Element Approximations," Computers and Math. with Applications, vol. 2, pp. 17-40, 1976.
[34] J. Eckstein and D. Bertsekas, "On the Douglas-Rachford Splitting Method and the Proximal Point Algorithm for Maximal Monotone Operators," Math. Programming, vol. 55, pp. 293-318, 1992.
[35] X. Yuan and M. Tao, "Recovering Low-Rank and Sparse Components of Matrices from Incomplete and Noisy Observations," SIAM J. Optimization, vol. 21, no. 1, pp. 57-81, 2011.
[36] B. He, "Parallel Splitting Augmented Lagrangian Methods for Monotone Structured Variational Inequalities," Computational Optimzation and Applications, vol. 42, no. 2, 2009.
[37] B. He, M. Tao, and X. Yuan, "Alternating Direction Method with Gaussian Back Substitution for Separable Convex Programming," Siam J. Optimization, under revision, 2011.
[38] R. Gross, I. Mathews, J. Cohn, T. Kanade, and S. Baker, "Multi-PIE," Proc. IEEE Int'l Conf. Automatic Face and Gesture Recognition, 2008.
[39] H. Ji, C. Liu, Z. Shen, and Y. Xu, "Robust Video Denoising Using Low Rank Matrix Completion," Proc. IEEE Int'l Conf. Computer Vision and Pattern Recognition, 2010.
[40] E. Candès, J. Cai, and T. Shen, "A Singular Value Thresholding Algorithm for Matrix Completion," SIAM J. Optimization, vol. 20, no. 4, pp. 1956-1982, 2010.
[41] R. Larsen, "Lanczos Bidiagonalization with Partial Reorthogonalization," technical report, Arhaus Univ., 1998.
[42] N. Halko, P. Martinsson, and J. Tropp, "Finding Structure with Randomness: Probabilistic Algorithms for Constructing Approximate Matrix Decompositions," SIAM Rev. vol. 53, no. 2, pp. 217-288, 2011.
[43] M. Mahoney, "Randomized Algorithms for Matrices and Data," rapid post, 2011.
[44] P. Viola and M.J. Jones, "Robust Real-Time Face Detection," Int'l J. Computer Vision, vol. 57, pp. 137-154, 2004.
[45] K. Wu, L. Wang, F. Soong, and Y. Yam, "A Sparse and Low-Rank Approach to Efficient Face Alignment for Photo-Real Talking Head Synthesis," Proc. IEEE Int'l Conf. Acoustics, Speech, and Signal Processing, 2011.
[46] W. Tan, G. Cheung, and Y. Ma, "Face Recovery in Conference Video Streaming Using Robust Principal Component Analysis" Proc. IEEE Int'l Conf. Image Processing, 2011.
[47] Z. Zhang, A. Ganesh, X. Liang, and Y. Ma, "Tilt: Transform-Invariant Low-Rank Textures," Int'l J. Computer Vision, accepted.
[48] H. Mobahi, Z. Zhou, A. Yang, and Y. Ma, "Holistic Reconstruction of Urban Structures from Low-Rank Textures," Proc. Int'l Conf. Computer Vision Workshops, 2011.
[49] Z. Zhang, X. Liang, A. Ganesh, and Y. Ma, "Camera Calibration with Lens Distortion from Low-Rank Textures," 2011.
[50] X. Zhang, Z. Lin, F. Sun, and Y. Ma, "Rectification of Chinese Characters as Transform Invariant Low-Rank Textures," preprint, 2011.
[51] R. Liu, Z. Lin, S. Wei, and Z. Su, "Solving Principal Component Pursuit in Linear Time via L1 Filtering," preprint, 2011.
[52] S. Becker, E. Candès, and M. Grant, "Templates for Convex Cone Problems with Applications to Sparse Signal Recovery," Math. Programming Computation, vol. 3, no. 3, pp. 165-218, 2011.
30 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool