The Community for Technology Leaders
2009 IEEE Conference on Computer Vision and Pattern Recognition (2009)
Miami, FL, USA
June 20, 2009 to June 25, 2009
ISBN: 978-1-4244-3992-8
pp: 2655-2662
Jixu Chen , Dept. of Electr., Comput.&Syst. Eng., Rensselaer Polytech. Inst., Troy, NY, USA
Minyoung Kim , Dept. of Electr., Comput.&Syst. Eng., Rensselaer Polytech. Inst., Troy, NY, USA
Yu Wang , Dept. of Electr., Comput.&Syst. Eng., Rensselaer Polytech. Inst., Troy, NY, USA
Qiang Ji , Dept. of Electr., Comput.&Syst. Eng., Rensselaer Polytech. Inst., Troy, NY, USA
ABSTRACT
Traditional dynamical systems used for motion tracking cannot effectively handle high dimensionality of the motion states and composite dynamics. In this paper, to address both issues simultaneously, we propose the marriage of the switching dynamical system and recent Gaussian Process Dynamic Models (GPDM), yielding a new model called the switching GPDM (SGPDM). The proposed switching variables enable the SGPDM to capture diverse motion dynamics effectively, and also allow to identify the motion class (e.g. walk or run in the human motion tracking, smile or angry in the facial motion tracking), which naturally leads to the idea of simultaneous motion tracking and classification. Moreover, each of GPDMs in SGPDM can faithfully model its corresponding primitive motion, while performing tracking in the low-dimensional latent space, therefore significantly improving the tracking efficiency. The proposed SGPDM is then applied to human body motion tracking and classification, and facial motion tracking and recognition. We demonstrate the performance of our model on several composite body motion videos obtained from the CMU database, including exercises and salsa dance. We also demonstrate the robustness of our model in terms of both facial feature tracking and facial expression/pose recognition performance on real videos under diverse scenarios including pose change, low frame rate and low quality videos.
INDEX TERMS
pose recognition, Gaussian process dynamic models, simultaneous composite motion tracking, switching dynamical system, switching GPDM, motion dynamics, facial motion tracking, simultaneous motion tracking, SGPDM, human body motion tracking, human body motion classification, facial motion recognition, composite body motion videos, CMU database, facial feature tracking, facial expression
CITATION

Jixu Chen, Yu Wang, Minyoung Kim and Qiang Ji, "Switching Gaussian Process Dynamic Models for simultaneous composite motion tracking and recognition," 2009 IEEE Conference on Computer Vision and Pattern Recognition(CVPR), Miami, FL, USA, 2009, pp. 2655-2662.
doi:10.1109/CVPRW.2009.5206580
334 ms
(Ver 3.3 (11022016))