The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.10 - October (2009 vol.31)
pp: 1817-1830
Huijun Di , Tsinghua University, Beijing
Linmi Tao , Tsinghua University, Beijing
Guangyou Xu , Tsinghua University, Beijing
ABSTRACT
Elastic motion is a nonrigid motion constrained only by some degree of smoothness and continuity. Consequently, elastic motion estimation by explicit feature matching actually contains two correlated subproblems: shape registration and motion tracking, which account for spatial smoothness and temporal continuity, respectively. If we ignore their interrelationship, solving each of them alone will be rather challenging, especially when the cluttered features are involved. To integrate them into a probabilistic model, one straightforward approach is to draw the dependence between their hidden states. With regard to their separated states, there are, however, two different explanations of motion which are still made under the individual constraint of smoothness or continuity. Each one can be error-prone, and their coupling causes error propagation. Therefore, it is highly desirable to design a probabilistic model in which a unified state is shared by the two subproblems. This paper is intended to propose such a model, i.e., a Mixture of Transformed Hidden Markov Models (MTHMM), where a unique explanation of motion is made simultaneously under the spatiotemporal constraints. As a result, the MTHMM could find a coherent global interpretation of elastic motion from local cluttered edge features, and experiments show its robustness under ambiguities, data missing, and outliers.
INDEX TERMS
Elastic motion, shape registration, mixture models, generative model.
CITATION
Huijun Di, Linmi Tao, Guangyou Xu, "A Mixture of Transformed Hidden Markov Models for Elastic Motion Estimation", IEEE Transactions on Pattern Analysis & Machine Intelligence, vol.31, no. 10, pp. 1817-1830, October 2009, doi:10.1109/TPAMI.2009.111
REFERENCES
[1] T. Huang, “Modeling, Analysis, and Visualization of Nonrigid Object Motion,” Proc. Int'l Conf. Pattern Recognition, 1990.
[2] C. Kambhamettu, D. Goldgof, D. Terzopoulos, and T. Huang, “Nonrigid Motion Analysis,” Handbook of PRIP: Computer Vision, vol. 2, Academic Press, 1994.
[3] J. Aggarwal, Q. Cai, W. Liao, and B. Sabata, “Nonrigid Motion Analysis: Articulated and Elastic Motion,” Computer Vision and Image Understanding, vol. 70, no. 2, pp. 142-156, 1998.
[4] M. Kass, A. Witkin, and D. Terzopoulos, “Snakes: Active Contour Models,” Int'l J. Computer Vision, vol. 1, no. 4, pp. 321-331, 1987.
[5] L. Staib and J. Duncan, “Boundary Finding with Parametrically Deformable Models,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 14, no. 11, pp. 1061-1075, Nov. 1992.
[6] T. Cootes, D. Cooper, C. Taylor, and J. Graham, “Active Shape Models—Their Training and Application,” Computer Vision and Image Understanding, vol. 61, no. 1, pp. 38-59, 1995.
[7] A. Blake and M. Isard, Active Contours. Springer, 1998.
[8] X. Huang, S. Zhang, Y. Wang, D. Metaxas, and D. Samaras, “A Hierarchical Framework for High Resolution Facial Expression Tracking,” Proc. Third IEEE Workshop Articulated and Nonrigid Motion, in conjunction with Conf. Computer Vision and Pattern Recognition, 2004.
[9] L. Shapiro, H. Wang, and J. Brady, “A Matching and Tracking Strategy for Independently Moving Objects,” Proc. British Machine Vision Conf., 1992.
[10] S. Beauchemin and J. Barron, “The Computation of Optical Flow,” ACM Computing Surveys, vol. 27, no. 3, pp. 433-467, 1995.
[11] S. Baker and I. Matthews, “Lucas-Kanade 20 Years On: A Unifying Framework,” Int'l J. Computer Vision, vol. 56, no. 3, pp. 221-255, 2004.
[12] J. Lim and M. Yang, “A Direct Method for Modeling Non-Rigid Motion with Thin Plate Spline,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2005.
[13] L. Torresani, D. Yang, E. Alexander, and C. Bregler, “Tracking and Modeling Non-Rigid Objects with Rank Constraints,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2001.
[14] B. Zitová and J. Flusser, “Image Registration Methods: A Survey,” Image and Vision Computing, vol. 21, no. 11, pp. 977-1000, 2003.
[15] J. Canny, “A Computational Approach to Edge Detection,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 8, no. 6, pp.679-698, Nov. 1986.
[16] S. Belongie, J. Malik, and J. Puzicha, “Shape Matching and Object Recognition Using Shape Contexts,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 24, no. 4, pp. 509-522, Apr. 2002.
[17] S. Manay, D. Cremers, B. Hong, A. Yezzi, and S. Soatto, “Integral Invariants for Shape Matching,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 28, no. 10, pp. 1602-1618, Oct. 2006.
[18] H. Tagare, “Shape-Based Nonrigid Correspondence with Application to Heart Motion Analysis,” IEEE Trans. Medical Imaging, vol. 18, no. 7, pp. 570-579, July 1999.
[19] M. Li and C. Kambhamettu, “Nonrigid Point Correspondence Recovery for Planar Curves Using Fourier Decomposition,” Proc. Asian Conf. Computer Vision, 2004.
[20] R. Davies, C. Twining, T. Cootes, J. Waterton, and C. Taylor, “A Minimum Description Length Approach to Statistical Shape Modeling,” IEEE Trans. Medical Imaging, vol. 21, no. 5, pp. 525-537, May 2002.
[21] A. Hill, C. Taylor, and A. Brett, “A Framework for Automatic Landmark Identification Using a New Method of Nonrigid Correspondence,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 22, no. 3, pp. 241-251, Mar. 2000.
[22] S. Xiang, F. Nie, and C. Zhang, “Contour Matching Based on Belief Propagation,” Proc. Asian Conf. Computer Vision, 2006.
[23] N. Duta, A. Jain, and M. Dubuisson-Jolly, “Automatic Construction of 2D Shape Models,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 23, no. 5, pp. 433-446, May 2001.
[24] A. Rangarajan, J. Coughlan, and A. Yuille, “A Bayesian Network Framework for Relational Shape Matching,” Proc. IEEE Int'l Conf. Computer Vision, 2003.
[25] Y. Zheng and D. Doermann, “Robust Point Matching for Nonrigid Shapes by Preserving Local Neighborhood Structures,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 28, no. 4, pp.643-649, Apr. 2006.
[26] P. Besl and N. Mckay, “A Method for Registration of 3-D Shapes,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 14, no. 2, pp. 239-256, Feb. 1992.
[27] Z. Zhang, “On Local Matching of Free-Form Curves,” Proc. British Machine Vision Conf., 1992.
[28] S. Rusinkiewicz and M. Levoy, “Efficient Variants of the ICP Algorithm,” Proc. Third Int'l Conf. 3D Digital Imaging and Modeling, 2001.
[29] A. Fitzgibbon, “Robust Registration of 2D and 3D Point Sets,” Image and Vision Computing, vol. 21, no. 13, pp. 1145-1153, 2003.
[30] H. Chui and A. Rangarajan, “A New Point Matching Algorithm for Non-Rigid Registration,” Computer Vision and Image Understanding, vol. 89, nos. 2/3, pp. 114-141, 2003.
[31] H. Guo, A. Rangarajan, S. Joshi, and L. Younes, “Non-Rigid Registration of Shapes via Diffeomorphic Point Matching,” Proc. IEEE Int'l Symp. Biomedical Imaging: Nano to Macro, 2004.
[32] H. Chui, A. Rangarajan, J. Zhang, and C. Leonard, “Unsupervised Learning of an Atlas from Unlabeled Point-Sets,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 26, no. 2, pp. 160-172, Feb. 2004.
[33] A. Myronenko, X. Song, and M. Carreira-Perpiñán, “Non-Rigid Point Set Registration: Coherent Point Drift,” Proc. Advances in Neural Information Processing Systems, 2006.
[34] Y. Tsin and T. Kanade, “A Correlation-based Approach to Robust Point Set Registration,” Proc. European Conf. Computer Vision, 2004.
[35] B. Jian and B. Vemuri, “A Robust Algorithm for Point Set Registration Using Mixture of Gaussians,” Proc. IEEE Int'l Conf. Computer Vision, 2005.
[36] J. Glaunes, A. Trouve, and L. Younes, “Diffeomorphic Matching of Distributions: A New Approach for Unlabelled Point-Sets and Sub-Manifolds Matching,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2004.
[37] F. Wang, B. Vemuri, and A. Rangarajan, “Groupwise Point Pattern Registration Using a Novel CDF-Based Jensen-Shannon Divergence,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2006.
[38] F. Wang, B. Vemuri, A. Rangarajan, and S. Eisenschenk, “Simultaneous Nonrigid Registration of Multiple Point Sets and Atlas Construction,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 30, no. 11, pp. 2011-2022, Nov. 2008.
[39] X. Huang, N. Paragios, and D. Metaxas, “Shape Registration in Implicit Spaces Using Information Theory and Free Form Deformations,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 28, no. 8, pp. 1303-1318, Aug. 2006.
[40] N. Paragios, M. Rousson, and V. Ramesh, “Non-Rigid Registration Using Distance Functions,” Computer Vision and Image Understanding, vol. 89, nos. 2/3, pp. 142-165, 2003.
[41] H. Munim and A. Farag, “Shape Representation and Registration Using Vector Distance Functions,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2007.
[42] N. Jojic, N. Petrovic, B. Frey, and T. Huang, “Transformed Hidden Markov Models: Estimating Mixture Models and Inferring Spatial Transformations in Video Sequences,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2000.
[43] B. Frey and N. Jojic, “Learning Graphical Models of Images, Videos and Their Spatial Transformations,” Proc. Uncertainty in Artificial Intelligence, 2000.
[44] T. Poggio and F. Girosi, “Networks for Approximation and Learning,” Proc. IEEE, vol. 78, no. 9, pp. 1481-1497, Sept. 1990.
[45] R. Kalman, “A New Approach to Linear Filtering and Prediction Problems,” J. Basic Eng., vol. 82, no. 1, pp. 35-45, 1960.
[46] F. Kschischang, B. Frey, and H. Loeliger, “Factor Graphs and the Sum-Product Algorithm,” IEEE Trans. Information Theory, vol. 47, no. 2, pp. 498-519, Feb. 2001.
[47] B. Frey and N. Jojic, “A Comparison of Algorithms for Inference and Learning in Probabilistic Graphical Models,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 27, no. 9, pp. 1392-1416, Sept. 2005.
[48] A. Dempster, N. Laird, and D. Rubin, “Maximum Likelihood from Incomplete Data via the EM Algorithm,” J. Royal Statistical Soc. B, vol. 39, no. 1, pp. 1-38, 1977.
[49] J. Magnus and H. Neudecker, Matrix Differential Calculus with Applications in Statistics and Econometrics, revised ed. John Wiley & Sons, 1999.
[50] L. Rabiner, “A Tutorial on Hidden Markov Models and Selected Applications in Speech Recognition,” Proc. IEEE, vol. 77, no. 2, pp.257-286, Feb. 1989.
[51] T. Kanade, J. Cohn, and Y. Tian, “Comprehensive Database for Facial Expression Analysis,” Proc. IEEE Int'l Conf. Automatic Face and Gesture Recognition, 2000.
[52] H. Di, N. Rao, G. Xu, and L. Tao, “Groupwise Shape Registration on Raw Edge Sequence via a Spatio-Temporal Generative Model,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2007.
23 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool