This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Action Spotting and Recognition Based on a Spatiotemporal Orientation Analysis
March 2013 (vol. 35 no. 3)
pp. 527-540
K. G. Derpanis, Dept. of Comput. Sci. & Eng., York Univ., Toronto, ON, Canada
M. Sizintsev, Dept. of Comput. Sci. & Eng., York Univ., Toronto, ON, Canada
K. J. Cannons, Dept. of Comput. Sci. & Eng., York Univ., Toronto, ON, Canada
R. P. Wildes, Dept. of Comput. Sci. & Eng., York Univ., Toronto, ON, Canada
This paper provides a unified framework for the interrelated topics of action spotting, the spatiotemporal detection and localization of human actions in video, and action recognition, the classification of a given video into one of several predefined categories. A novel compact local descriptor of video dynamics in the context of action spotting and recognition is introduced based on visual spacetime oriented energy measurements. This descriptor is efficiently computed directly from raw image intensity data and thereby forgoes the problems typically associated with flow-based features. Importantly, the descriptor allows for the comparison of the underlying dynamics of two spacetime video segments irrespective of spatial appearance, such as differences induced by clothing, and with robustness to clutter. An associated similarity measure is introduced that admits efficient exhaustive search for an action template, derived from a single exemplar video, across candidate video sequences. The general approach presented for action spotting and recognition is amenable to efficient implementation, which is deemed critical for many important applications. For action spotting, details of a real-time GPU-based instantiation of the proposed approach are provided. Empirical evaluation of both action spotting and action recognition on challenging datasets suggests the efficacy of the proposed approach, with state-of-the-art performance documented on standard datasets.
Index Terms:
Spatiotemporal phenomena,Clutter,Energy measurement,Visualization,Dynamics,Robustness,Cameras,real-time implementations,Action spotting,action recognition,action representation,human motion,visual spacetime,spatiotemporal orientation,template matching
Citation:
K. G. Derpanis, M. Sizintsev, K. J. Cannons, R. P. Wildes, "Action Spotting and Recognition Based on a Spatiotemporal Orientation Analysis," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 35, no. 3, pp. 527-540, March 2013, doi:10.1109/TPAMI.2012.141
Usage of this product signifies your acceptance of the Terms of Use.