The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.06 - June (2013 vol.35)
pp: 1383-1396
Simon Lucey , Commonwealth Science and Industrial Research Organisation (CSIRO), Brisbane
Rajitha Navarathna , Queensland University of Technology, Brisbane
Ahmed Bilal Ashraf , University of Pennsylvania, Philadelphia
Sridha Sridharan , Queensland University of Technology, Brisbane
ABSTRACT
In this paper, we propose a framework for both gradient descent image and object alignment in the Fourier domain. Our method centers upon the classical Lucas & Kanade (LK) algorithm where we represent the source and template/model in the complex 2D Fourier domain rather than in the spatial 2D domain. We refer to our approach as the Fourier LK (FLK) algorithm. The FLK formulation is advantageous when one preprocesses the source image and template/model with a bank of filters (e.g., oriented edges, Gabor, etc.) as 1) it can handle substantial illumination variations, 2) the inefficient preprocessing filter bank step can be subsumed within the FLK algorithm as a sparse diagonal weighting matrix, 3) unlike traditional LK, the computational cost is invariant to the number of filters and as a result is far more efficient, and 4) this approach can be extended to the Inverse Compositional (IC) form of the LK algorithm where nearly all steps (including Fourier transform and filter bank preprocessing) can be precomputed, leading to an extremely efficient and robust approach to gradient descent image matching. Further, these computational savings translate to nonrigid object alignment tasks that are considered extensions of the LK algorithm, such as those found in Active Appearance Models (AAMs).
INDEX TERMS
Active appearance model, Jacobian matrices, Integrated circuits, Vectors, Robustness, Linear programming, Lighting,active appearance model (AAM), Lucas & Kanade (LK), Fourier domain, illumination invariance
CITATION
Simon Lucey, Rajitha Navarathna, Ahmed Bilal Ashraf, Sridha Sridharan, "Fourier Lucas-Kanade Algorithm", IEEE Transactions on Pattern Analysis & Machine Intelligence, vol.35, no. 6, pp. 1383-1396, June 2013, doi:10.1109/TPAMI.2012.220
REFERENCES
[1] B. Lucas and T. Kanade, "An Iterative Image Registration Technique with an Application to Stereo Vision," Proc. Int'l Joint Conf. Artificial Intelligence, pp. 674-679, 1981.
[2] S. Baker and I. Matthews, "Lucas-Kanade 20 Years On: A Unifying Framework: Part 1: The Quantity Approximated, the Warp Update Rule, and the Gradient Descent Approximation." Int'l J. Computer Vision, vol. 56, no. 3, pp. 221-255, Feb. 2004.
[3] I. Matthews and S. Baker, "Active Appearance Models Revisited," Int'l J. Computer Vision, vol. 60, no. 1, pp. 135-164, Nov. 2004.
[4] S. Baker and I. Matthews, "Equivalence and Efficiency of Image Alignment Algorithms," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2001.
[5] E. Land and J. McCann, "Lightness and Retinex Theory," J. Optical Soc. of Am., vol. 61, pp. 1-11, 1971.
[6] C. Wiskott, J.M. Fellous, N. Krüger, and C. von der Malsburg, "Face Recognition by Elastic Bunch Graph Matching," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 19, no. 7, pp. 775-779, July 1997.
[7] C. Liu and H. Wechsler, "Gabor Feature Based Classification Using the Enhanced Fisher Linear Discriminant Model for Face Recognition," IEEE Trans. Image Processing, vol. 11, no. 4, pp. 467-476, Apr. 2002.
[8] M.S. Bartlett, G. Littlewort, M. Frank, C. Lainscesk, I. Fasel, and J. Movellan, "Recognizing Facial Expression: Machine Learning and Application to Spontaneous Behavior," Proc. IEEE Conf. Computer Vision and Pattern Recognition, vol. 2, pp. 568-573, June 2005.
[9] Z. Li, D. Lin, and X. Tang, "Nonparametric Discriminant Analysis for Face Recognition," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 31, no. 4, pp. 755-761, Apr. 2009.
[10] A.B. Ashraf, S. Lucey, and T. Chen, "Fast Image Alignment in the Fourier Domain," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 2480-2487, 2010.
[11] R. Navarathna, S. Lucey, and S. Sridharan, "Fourier Active Appearance Model," Proc. IEEE Int'l Conf. Computer Vision, 2011.
[12] A.V. Oppenheim and A.S. Willsky, Signals and Systems, second ed. Prentice Hall, 1996.
[13] G.D. Hager and P.N. Belhumeur, "Efficient Region Tracking with Parametric Models of Geometry and Illumination," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 20, no. 10, pp. 1025-1039, Oct. 1998.
[14] P.N. Belhumeur and D.J. Kriegman, "What Is the Set of Images of an Object under All Possible Lighting Conditions?" Proc. IEEE Conf. Computer Vision and Pattern Recognition, 1996.
[15] S. Avidan, "Support Vector Tracking," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 26, no. 8, pp. 1064-1072, Aug. 2004.
[16] S. Lucey, "Enforcing Non-Positive Weights for Stable Support Vector Tracking," Proc. IEEE Conf. Computer Vision and Pattern Recognition, June 2008.
[17] X. Liu, "Generic Face Alignment Using Boosted Appearance Model," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 1-8, 2007.
[18] M.H. Nguyen and F. De la Torre, "Local Minima Free Parameterized Appearance Models," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2008.
[19] M. Black and A. Jepson, "Eigen-Tracking: Robust Matching and Tracking of Articulated Objects Using a View-Based Representation." Int'l J. Computer Vision, vol. 36, no. 2, pp. 101-130, 1998.
[20] B. Theobald, "Evaluating Error Functions for Robust Active Appearance Models," Proc. IEEE Int'l Conf. Automatic Face and Gesture Recognition, pp. 149-154, 2006.
[21] G.D. Evangelidis and E.Z. Psarakis, "Parametric Image Alignment Using Enhanced Correlation Coefficient Maximization," IEEE Trans. Pattern Analyis and Machine Intelligence, vol. 30, no. 10, pp. 1858-1865, Oct. 2008.
[22] N. Dowson and R. Bowden, "Mutual Information for Lucas-Kanade Tracking (MILK): An Inverse Compositional Formulation," IEEE Trans. Pattern Analyis and Machine Intelligence, vol. 30, no. 1, pp. 180-185, Jan. 2008.
[23] G. Tzimiropoulos, S. Zafeiriou, and M. Pantic, "Robust and Efficient Parametric Face Alignment," Proc. IEEE Int'l Conf. Computer Vision, 2011.
[24] R. Gross, I. Matthews, and S. Baker, "Generic vs. Person Specific Active Appearance Models," Image and Vision Computing, vol. 23, no. 1, pp. 1080-1093, Nov. 2005.
[25] S. Baker, R. Gross, I. Matthews, and T. Ishikawa, "Lucas-Kanade 20 Years On: A Unifying Framework: Part 2," Technical Report CMU-RI-TR-03-01, Robotics Inst., Feb. 2003.
[26] T. Cootes, G. Edwards, and C. Taylor, "Active Appearance Models," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 23, no. 6, pp. 681-685, June 2001.
[27] R. Gross and V. Brajovic, "An Image Pre-Processing Algorithm for Illumination Invariant Face Recognition," Proc. Fourth Int'l Conf. Audio-and Video Based Biometric Person Authentication, pp. 10-18, 2003.
[28] M. Bartlett, G. Littlewort, C. Lainscsek, I. Fasel, M. Frank, and J. Movellan, "Fully Automatic Facial Action Recognition in Spontaneous Behavior," Proc. Seventh Int'l Conf. Automatic Face and Gesture Recognition, pp. 223-230, 2006.
[29] R. Gross, J.S. Baker, I. Matthews, and T. Kanade, "Multi-PIE," Proc. IEEE Int'l Conf. Automatic Face and Gesture Recognition, 2008.
[30] J.F. Cohn, "Advances in Behavioral Science Using Automated Facial Image Analysis and Synthesis," IEEE Signal Processing Magazine, vol. 27, no. 6, Nov. 2010.
[31] B. Lee, M. Hasegawa-Johnson, C. Goudeseune, S. Kamdar, S. Borys, M. Liu, and T. Huang, "AVICAR: An Audiovisual Speech Corpus in a Car Environment," Proc. Interspeech, pp. 2489-2492, 2004.
45 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool