This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Learning to Track and Identify Players from Broadcast Sports Videos
July 2013 (vol. 35 no. 7)
pp. 1704-1716
Wei-Lwun Lu, Google, Mountain View, CA, USA
J.-A Ting, Robert Bosch Res. & Technol. Center, Palo Alto, CA, USA
J. J. Little, Dept. of Comput. Sci., Univ. of British Columbia, Vancouver, BC, Canada
K. P. Murphy, Google, Mountain View, CA, USA
Tracking and identifying players in sports videos filmed with a single pan-tilt-zoom camera has many applications, but it is also a challenging problem. This paper introduces a system that tackles this difficult task. The system possesses the ability to detect and track multiple players, estimates the homography between video frames and the court, and identifies the players. The identification system combines three weak visual cues, and exploits both temporal and mutual exclusion constraints in a Conditional Random Field (CRF). In addition, we propose a novel Linear Programming (LP) Relaxation algorithm for predicting the best player identification in a video clip. In order to reduce the number of labeled training data required to learn the identification system, we make use of weakly supervised learning with the assistance of play-by-play texts. Experiments show promising results in tracking, homography estimation, and identification. Moreover, weakly supervised learning with play-by-play texts greatly reduces the number of labeled training examples required. The identification system can achieve similar accuracies by using merely 200 labels in weakly supervised learning, while a strongly supervised approach needs a least 20,000 labels.
Index Terms:
weakly supervised learning,Sports video analysis,identification,tracking
Citation:
Wei-Lwun Lu, J.-A Ting, J. J. Little, K. P. Murphy, "Learning to Track and Identify Players from Broadcast Sports Videos," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 35, no. 7, pp. 1704-1716, July 2013, doi:10.1109/TPAMI.2012.242
Usage of this product signifies your acceptance of the Terms of Use.