The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.05 - May (2013 vol.35)
pp: 1051-1065
Weiming Hu , Nat. Lab. of Pattern Recognition (NLPR), Inst. of Autom., Beijing, China
Xi Li , Nat. Lab. of Pattern Recognition (NLPR), Inst. of Autom., Beijing, China
Guodong Tian , Nat. Lab. of Pattern Recognition (NLPR), Inst. of Autom., Beijing, China
S. Maybank , Dept. of Comput. Sci. & Inf. Syst, Birkbeck Coll., London, UK
Zhongfei Zhang , Dept. of Comput. Sci., Binghamton Univ., Binghamton, NY, USA
ABSTRACT
Trajectory analysis is the basis for many applications, such as indexing of motion events in videos, activity recognition, and surveillance. In this paper, the Dirichlet process mixture model (DPMM) is applied to trajectory clustering, modeling, and retrieval. We propose an incremental version of a DPMM-based clustering algorithm and apply it to cluster trajectories. An appropriate number of trajectory clusters is determined automatically. When trajectories belonging to new clusters arrive, the new clusters can be identified online and added to the model without any retraining using the previous data. A time-sensitive Dirichlet process mixture model (tDPMM) is applied to each trajectory cluster for learning the trajectory pattern which represents the time-series characteristics of the trajectories in the cluster. Then, a parameterized index is constructed for each cluster. A novel likelihood estimation algorithm for the tDPMM is proposed, and a trajectory-based video retrieval model is developed. The tDPMM-based probabilistic matching method and the DPMM-based model growing method are combined to make the retrieval model scalable and adaptable. Experimental comparisons with state-of-the-art algorithms demonstrate the effectiveness of our algorithm.
INDEX TERMS
Trajectory, Discrete Fourier transforms, Videos, Clustering algorithms, Vectors, Hidden Markov models, Feature extraction, video retrieval, Trajectory clustering and modeling, incremental clustering, Dirichlet process mixture model, time-sensitive Dirichlet process mixture model
CITATION
Weiming Hu, Xi Li, Guodong Tian, S. Maybank, Zhongfei Zhang, "An Incremental DPMM-Based Method for Trajectory Clustering, Modeling, and Retrieval", IEEE Transactions on Pattern Analysis & Machine Intelligence, vol.35, no. 5, pp. 1051-1065, May 2013, doi:10.1109/TPAMI.2012.188
REFERENCES
[1] J.J. Little and Z. Gu, "Video Retrieval by Spatial and Temporal Structure of Trajectories," Proc. SPIE Storage and Retrieval for Media Databases, vol. 4315, pp. 545-552, 2001.
[2] N. Johnson and D. Hogg, "Learning the Distribution of Object Trajectories for Event Recognition," Image and Vision Computing, vol. 14, no. 8, pp. 609-615, 1996.
[3] X. Ma, F. Bashir, A.A. Khokhar, and D. Schonfeld, "Event Analysis Based on Multiple Interactive Motion Trajectories," IEEE Trans. Circuits and Systems for Video Technology, vol. 19, no. 3, pp. 397-406, Mar. 2009.
[4] S. Atev, G. Miller, and N.P. Papanikolopoulos, "Clustering of Vehicle Trajectories," IEEE Trans. Intelligent Transportation Systems, vol. 11, no. 3, pp. 647-657, Sept. 2010.
[5] J. Alon, S. Sclaroff, G. Kollios, and V. Pavlovic, "Discovering Clusters in Motion Time-Series Data," Proc. IEEE Conf. Computer Vision and Pattern Recognition, vol. 1, pp: I-375-I-381, 2003.
[6] E. Sahouria and A. Zakhor, "Motion Indexing of Video," Proc. Int'l Conf. Image Processing, vol. 2, pp. 526-529, Oct. 1997.
[7] M. Vlachos, G. Kollios, and D. Gunopulos, "Discovering Similar Multidimensional Trajectories," Proc. Int'l Conf. Data Eng., pp. 673-684, 2002.
[8] A. Naftel and S. Khalid, "Motion Trajectory Learning in the DFT-Coefficient Feature Space," Proc. IEEE Int'l Conf. Computer Vision Systems, pp. 47-47, Jan. 2006.
[9] J. Hsieh, S. Yu, and Y. Chen, "Motion-Based Video Retrieval by Trajectory Matching," IEEE Trans. Circuits and Systems for Video Technology, vol. 16, no. 3, pp. 396-409, Mar. 2006.
[10] T. Ferguson, "A Bayesian Analysis of Some Non-Parametric Problems," Ann. of Statistics, vol. 1, no. 2, pp. 209-230, Mar. 1973.
[11] D. Blackwell and J.B. MacQueen, "Ferguson Distribution via Polya Urn Schemes," Ann. of Statistics, vol. 1, no. 2, pp. 353-355, 1973.
[12] D.M. Blei and M.I. Jordan, "Variational Methods for the Dirichlet Process," Proc. Int'l Conf. Machine Learning, pp. 121-144, 2004.
[13] J. Sun, W. Zhang, X. Tang, and H. Shum, "Bidirectional Tracking Using Trajectory Segment Analysis," Proc. IEEE Int'l Conf. Computer Vision, vol. 1, pp. 717-724, 2005.
[14] X. Zhu, Z. Ghahramani, and J. Lafferty, "Time-Sensitive Dirichlet Process Mixture Models," Technical Report CMUCALD-05-104, School of Computer Science, Carnegie Mellon Univ., 2005.
[15] D. Comaniciu and P. Meer, "Mean Shift: A Robust Approach toward Feature Space Analysis," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 24, no. 5, pp. 603-619, May 2002.
[16] R. Neal, "Markov Chain Sampling Methods for Dirichlet Process Mixture Models," J. Computational and Graphical Statistics, vol. 9, no. 2, pp. 249-265, June 2000.
[17] C. Zhang, S. Zu, and Y. Gong, "Trend Analysis for Large Document Streams," Proc. Int'l Conf. Machine Learning and Applications, pp. 285-295, Dec. 2006.
[18] F.I. Bashir, A.A. Khokhar, and D. Schonfeld, "Real-Time Motion Trajectory-Based Indexing and Retrieval of Video Sequences," IEEE Trans. Multimedia, vol. 9, no. 1, pp. 58-65, Jan. 2007.
[19] B. Georgescu, I. Shimshoni, and P. Meer, "Mean Shift Based Clustering in High Dimensions: A Texture Classification Example," Proc. IEEE Int'l Conf. Computer Vision, vol. 1, pp. 456-463, 2003.
[20] C.R. Jung, L. Hennemann, and S.R. Musse, "Event Detection Using Trajectory Clustering and 4-D Histograms," IEEE Trans. Circuits and Systems for Video Technology, vol. 18, no. 11, pp. 1565-1575, Nov. 2008.
[21] B.T. Morris and M.M. Trivedi, "A Survey of Vision-Based Trajectory Learning and Analysis for Surveillance," IEEE Trans. Circuits and Systems for Video Technology, vol. 18, no. 8, pp. 1114-1127, Aug. 2008.
[22] I. Saleemi, K. Shafique, and M. Shah, "Probabilistic Modeling of Scene Dynamics for Applications in Visual Surveillance," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 31, no. 8, pp. 1472-1485, Aug. 2009.
[23] B.T. Morris and M.M. Trivedi, "Learning, Modeling, and Classification of Vehicle Track Patterns from Live Video," IEEE Trans. Intelligent Transportation Systems, vol. 9, no. 3, pp. 425-437, Sept. 2008.
[24] N. Piotto, N. Conci, and F.G.B. De Natale, "Syntactic Matching of Trajectories for Ambient Intelligence Applications," IEEE Trans. Multimedia, vol. 11, no. 7, pp. 1266-1275, Nov. 2009.
[25] H. Veeraraghavan and N.P. Papanikolopoulos, "Learning to Recognize Video-Based Spatiotemporal Events," IEEE Trans. Intelligent Transportation Systems, vol. 10, no. 4, pp. 628-638, Dec. 2009.
[26] S. Dagtas and W. Al-Khatib, "Models for Motion-Based Video Indexing and Retrieval," IEEE Trans. Image Processing, vol. 9, no. 1, pp. 88-101, Jan. 2000.
[27] Y.K. Jung, K.W. Lee, and Y.S. Ho, "Content-Based Event Retrieval Using Semantic Scene Interpretation for Automated Traffic Surveillance," IEEE Trans. Intelligent Transportation Systems, vol. 2, no. 3, pp. 151-163, Sept. 2001.
[28] T. Pavlidis, "Polygonal Approximation by Newton's Method," IEEE Trans. Computers, vol. 26, no. 8, pp. 800-807, Aug. 1977.
[29] F.S. Cohen, Z. Huang, and Z. Yang, "Invariant Matching and Identification of Curves Using B-Splines Curve Representation," IEEE Trans. Image Processing, vol. 4, no. 1, pp. 1-10, Jan. 1995.
[30] N. Ansari and E.J. Delp, "On Detecting Dominant Points," Pattern Recognition, vol. 24, no. 5, pp. 441-451, 1991.
[31] Z. Gu, "Video Database Retrieval Based on Trajectory Analysis," master's thesis, Dept. of Computer Science, Univ. of British Columbia, 1997.
[32] C. Yajima, Y. Nakanishi, and K. Tanaka, "Querying Video Data by Spatio-Temporal Relationships of Moving Object Traces," Proc. IFIP 2.6 Working Conf. Visual Database Systems, pp. 357-371, May 2002.
[33] Y.W. Teh, "Dirichlet Process," Encyclopedia of Machine Learning, pp. 280-287, Springer, 2010.
[34] S. Chib, Markov Chain Monte Carlo Technology, pp. 89-92. Springer, 2004.
[35] C.-W. Su, H.-Y.M. Liao, H.-R. Tyan, C.-W. Lin, D.-Y. Chen, and K.-C. Fan, "Motion Flow-Based Video Retrieval," IEEE Trans. Multimedia, vol. 9, no. 6, pp. 1193-1201, Oct. 2007.
[36] A. Naftel and S. Khalid, "Classification and Prediction of Motion Trajectories Using Spatiotemporal Approximation," Proc. Int'l Workshop Human Activity Recognition and Modeling, pp. 17-26, 2005.
[37] E. Keogh, "Exact Indexing of Dynamic Time Warping," Proc. Int'l Conf. Very Large Data Bases, pp. 406-417, 2002.
[38] E.J. Keogh and M.J. Pazzani, "Scaling Up Dynamic Time Warping for Datamining Applications," Proc. Int'l Conf. Knowledge Discovery and Data Mining, pp. 285-289, 2000.
[39] E. Keogh, T. Palpanas, V.B. Zordan, D. Gunopulos, and M. Cardle, "Indexing Large Human-Motion Databases," Proc. Int'l Conf. Very Large Data Bases, pp. 780-791, 2004.
[40] L. Chen, M.T. Ozsu, and V. Oria, "Robust and Fast Similarity Search for Moving Object Trajectories," Proc. ACM SIGMOD Int'l Conf. Management of Data, pp. 491-502, 2005.
[41] B.T. Morris and M.M. Trivedi, "Learning Trajectory Patterns by Clustering: Experimental Studies and Comparative Evaluation," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 312-319, 2009.
[42] L. Chen and R. Ng, "On the Marriage of LP-Norms and Edit Distance," Proc. Int'l Conf. Very Large Data Bases, pp. 792-803, 2004.
[43] T. Palpanas, M. Vlachos, E. Keogh, D. Gunopulos, and W. Truppel, "Online Amnesic Approximation of Streaming Time Series," Proc. IEEE Int'l Conf. Data Eng., pp. 338-349, Mar. 2004.
[44] B.T. Morris and M.M. Trivedi, "Trajectory Learning for Activity Understanding: Unsupervised, Multilevel, and Long-Term Adaptive Approach," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 33, no. 11, pp. 2287- 2301, Nov. 2011.
[45] X. Wang, H. Ding, G. Trajcevski, P. Scheuermann, and E.J. Keogh, "Experimental Comparison of Representation Methods and Distance Measures for Time Series Data," Data Mining and Knowledge Discovery, vol. 26, no. 2, pp. 275-309, Mar. 2013.
15 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool