The Community for Technology Leaders
Green Image
Issue No. 03 - March (2009 vol. 31)
ISSN: 0162-8828
pp: 539-555
Xiaoxu Ma , MIT, Cambridge
Xiaogang Wang , MIT, Cambridge
W.E.L. Grimson , MIT, Cambridge
We propose a novel unsupervised learning framework to model activities and interactions in crowded and complicated scenes. Hierarchical Bayesian models are used to connect three elements in visual surveillance: low-level visual features, simple "atomic" activities, and interactions. Atomic activities are modeled as distributions over low-level visual features, and multi-agent interactions are modeled as distributions over atomic activities. These models are learnt in an unsupervised way. Given a long video sequence, moving pixels are clustered into different atomic activities and short video clips are clustered into different interactions. In this paper, we propose three hierarchical Bayesian models, Latent Dirichlet Allocation (LDA) mixture model, Hierarchical Dirichlet Process (HDP) mixture model, and Dual Hierarchical Dirichlet Processes (Dual-HDP) model. They advance existing language models, such as LDA [1] and HDP [2]. Our data sets are challenging video sequences from crowded traffic scenes and train station scenes with many kinds of activities co-occurring. Without tracking and human labeling effort, our framework completes many challenging visual surveillance tasks of board interest such as: (1) discovering typical atomic activities and interactions; (2) segmenting long video sequences into different interactions; (3) segmenting motions into different activities; (4) detecting abnormality; and (5) supporting high-level queries on activities and interactions.
Vision and Scene Understanding, Artificial Intelligence, Computing Methodologies, Video analysis, Machine learning, Motion, Applications, Statistical, Computer vision, Algorithms, Clustering, Pattern Recognition, Computing Methodologies
Xiaoxu Ma, Xiaogang Wang, W.E.L. Grimson, "Unsupervised Activity Perception in Crowded and Complicated Scenes Using Hierarchical Bayesian Models", IEEE Transactions on Pattern Analysis & Machine Intelligence, vol. 31, no. , pp. 539-555, March 2009, doi:10.1109/TPAMI.2008.87
91 ms
(Ver 3.1 (10032016))