The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.01 - Jan. (2014 vol.36)
pp: 140-156
Remi Emonet , Idiap Res. Inst., Martigny, Switzerland
Jagannadan Varadarajan , Idiap Res. Inst., Martigny, Switzerland
Jean-Marc Odobez , Idiap Res. Inst., Martigny, Switzerland
ABSTRACT
In this paper, we present a new model for unsupervised discovery of recurrent temporal patterns (or motifs) in time series (or documents). The model is designed to handle the difficult case of multivariate time series obtained from a mixture of activities, that is, our observations are caused by the superposition of multiple phenomena occurring concurrently and with no synchronization. The model uses nonparametric Bayesian methods to describe both the motifs and their occurrences in documents. We derive an inference scheme to automatically and simultaneously recover the recurrent motifs (both their characteristics and number) and their occurrence instants in each document. The model is widely applicable and is illustrated on datasets coming from multiple modalities, mainly videos from static cameras and audio localization data. The rich semantic interpretation that the model offers can be leveraged in tasks such as event counting or for scene analysis. The approach is also used as a mean of doing soft camera calibration in a camera network. A thorough study of the model parameters is provided and a cross-platform implementation of the inference algorithm will be made publicly available.
INDEX TERMS
multivariate time series, Motif mining, mixed activity, unsupervised activity analysis, topic models, multicamera, camera network, nonparametric models, Bayesian modeling,
CITATION
Remi Emonet, Jagannadan Varadarajan, Jean-Marc Odobez, "Temporal Analysis of Motif Mixtures Using Dirichlet Processes", IEEE Transactions on Pattern Analysis & Machine Intelligence, vol.36, no. 1, pp. 140-156, Jan. 2014, doi:10.1109/TPAMI.2013.100
REFERENCES
[1] R. Emonet, J. Varadarajan, and J. Odobez, "Extracting and Locating Temporal Motifs in Video Scenes Using a Hierarchical Non Parametric Bayesian Model," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2011.
[2] Y. Yang, J. Liu, and M. Shah, "Video Scene Understanding Using Multi-Scale Analysis," Proc. IEEE Int'l Conf. Computer Vision, 2009.
[3] X. Wang, X. Ma, and E.L. Grimson, "Unsupervised Activity Perception in Crowded and Complicated Scenes Using Hierarchical Bayesian Models," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 31, no. 3, pp. 539-555, Mar. 2009.
[4] J. Varadarajan and J. Odobez, "Topic Models for Scene Analysis and Abnormality Detection," Proc. 12th IEEE Int'l Conf. Computer Vision Workshop on Visual Surveillance, 2009.
[5] D. Kuettel, M.D. Breitenstein, L.V. Gool, and V. Ferrari, "What's Going On? Discovering Spatio-Temporal Dependencies in Dynamic Scenes," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2010.
[6] D. Blei and J. Lafferty, "Dynamic Topic Models," Proc. 23rd Int'l Conf. Machine Learning, 2006.
[7] X. Wang and A. McCallum, "Topics over Time: A Non-Markov Continuous-Time Model of Topical Trends," Proc. Conf. Knowledge Discovery and Data Mining, 2006.
[8] T. Hospedales, S. Gong, and T. Xiang, "A Markov Clustering Topic Model for Mining Behavior in Video," Proc. IEEE Int'l Conf. Computer Vision, 2009.
[9] J. Li, S. Gong, and T. Xiang, "Discovering Multi-Camera Behaviour Correlations for On-the-Fly Global Activity Prediction and Anomaly Detection," Proc. IEEE 12th Int'l Conf. Computer Vision Workshop on Visual Surveillance, 2009.
[10] T.A. Faruquie, P.K. Kalra, and S. Banerjee, "Time Based Activity Inference Using Latent Dirichlet Allocation," Proc. British Machine Vision Conf., 2009.
[11] J. Varadarajan, R. Emonet, and J. Odobez, "Probabilistic Latent Sequential Motifs: Discovering Temporal Activity Patterns in Video Scenes." Proc. British Machine Vision Conf., 2010.
[12] Y.W. Teh, M.I. Jordan, M.J. Beal, and D.M. Blei, "Hierarchical Dirichlet Processes," J. Am. Statistical Assoc., vol. 101, no. 476, pp. 1566-1581, 2006.
[13] X. Wang, K. Ma, G. Ng, and W. Grimson, "Trajectory Analysis and Semantic Region Modeling Using a Nonparametric Bayesian Model," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2008.
[14] T.S.F. Haines and T. Xiang, "Delta-Dual Hierarchical Dirichlet Processes: A Pragmatic Abnormal Behaviour Detector," Proc. IEEE Int'l Conf. Computer Vision, 2011.
[15] E. Jouneau and C. Carincotte, "Particle-Based Tracking Model for Automatic Anomaly Detection," Proc. 18th IEEE Int'l Conf. Image Processing (ICIP), 2011.
[16] O. Javed and M. Shah, "Tracking in Multiple Cameras with Disjoint Views," Automated Multi-Camera Surveillance: Algorithms and Practice, pp. 1-26, Springer, 2008.
[17] C.C. Loy, T. Xiang, and S. Gong, "Multi-Camera Activity Correlation Analysis," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 1988-1995, 2009.
[18] X. Wang, K. Tieu, and W. Grimson, "Correspondence-Free Multi-Camera Activity Analysis and Scene Modeling," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2008.
[19] X. Wang, K. Tieu, and E. Grimson, "Correspondence-Free Activity Analysis and Scene Modeling in Multiple Camera Views," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 31, no. 1, pp. 893-908, Jan. 2009.
[20] P. Marmaroli, J.-M. Odobez, X. Falourd, and H. Lissek, "A Bimodal Sound Source Model for Vehicle Tracking in Traffic Monitoring," Proc. 19th European Signal Processing Conf., 2011.
[21] C. Wang and D. Blei, "Decoupling Sparsity and Smoothness in the Discrete Hierarchical Dirichlet Process," Proc. Advances in Neural Information Processing Systems, 2009.
[22] R. Emonet, J. Varadarajan, and J.-M. Odobez, "Multi-Camera Open Space Human Activity Discovery for Anomaly Detection," Proc. Eighth IEEE Int'l Conf. Advanced Video and Signal Based Surveillance, p. 6, Aug. 2011.
[23] B. Zhou, X. Wang, and X. Tang, "Random Field Topic Model for Semantic Region Analysis in Crowded Scenes from Tracklets," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2011.
[24] J. Varadarajan, R. Emonet, and J.-M. Odobez, "Bridging the Past, Present and Future: Modeling Scene Activities from Event Relationships and Global Rules," Proc. IEEE Conf. Computer Vision and Pattern Recognition, June 2012.
66 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool