The Community for Technology Leaders
RSS Icon
Issue No.04 - April (2013 vol.35)
pp: 898-910
Chang Huang , Baidu USA LLC, Cupertino, CA, USA
Yuan Li , Google, Inc., Los Angeles, CA, USA
R. Nevatia , Inst. for Robot. & Intell. Syst., Univ. of Southern California, Los Angeles, CA, USA
We propose a hierarchical association approach to multiple target tracking from a single camera by progressively linking detection responses into longer track fragments (i.e., tracklets). Given frame-by-frame detection results, a conservative dual-threshold method that only links very similar detection responses between consecutive frames is adopted to generate initial tracklets with minimum identity switches. Further association of these highly fragmented tracklets at each level of the hierarchy is formulated as a Maximum A Posteriori (MAP) problem that considers initialization, termination, and transition of tracklets as well as the possibility of them being false alarms, which can be efficiently computed by the Hungarian algorithm. The tracklet affinity model, which measures the likelihood of two tracklets belonging to the same target, is a linear combination of automatically learned weak nonparametric models upon various features, which is distinct from most of previous work that relies on heuristic selection of parametric models and manual tuning of their parameters. For this purpose, we develop a novel bag ranking method and train the crucial tracklet affinity models by the boosting algorithm. This bag ranking method utilizes the soft max function to relax the oversufficient objective function used by the conventional instance ranking method. It provides a tighter upper bound of empirical errors in distinguishing correct associations from the incorrect ones, and thus yields more accurate tracklet affinity models for the tracklet association problem. We apply this approach to the challenging multiple pedestrian tracking task. Systematic experiments conducted on two real-life datasets show that the proposed approach outperforms previous state-of-the-art algorithms in terms of tracking accuracy, in particular, considerably reducing fragmentations and identity switches.
Target tracking, Trajectory, Computational modeling, Joining processes, Object detection, Image color analysis,AdaBoost, Multiple target tracking, hierarchical association, bag ranking
Chang Huang, Yuan Li, R. Nevatia, "Multiple Target Tracking by Learning-Based Hierarchical Association of Detection Responses", IEEE Transactions on Pattern Analysis & Machine Intelligence, vol.35, no. 4, pp. 898-910, April 2013, doi:10.1109/TPAMI.2012.159
[1] D. Comaniciu, V. Ramesh, and P. Meer, "The Variable Bandwidth Mean Shift and Data-Driven Scale Selection," Proc. IEEE Int'l Conf. Computer Vision, 2001.
[2] C. Tomasi and T. Kanade, "Detection and Tracking of Point Features," Technical Report CMUCS- 91-132, Carnegie Mellon Univ., 1991.
[3] T. Zhao and R. Nevatia, "Tracking Multiple Humans in Complex Situations," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 26, no. 9, pp. 1208-1221, Sept. 2004.
[4] P. Viola and M. Jones, "Rapid Object Detection Using a Boosted Cascade of Simple Features," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2001.
[5] Q. Zhu, S. Avidan, M.C. Yeh, and K.T. Cheng, "Fast Human Detection Using a Cascade of Histograms of Oriented Gradients," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2006.
[6] B. Wu and R. Nevatia, "Detection and Tracking of Multiple, Partially Occluded Humans by Bayesian Combination of Edgelet Based Part Detectors," Int'l J. Computer Vision, vol. 75, pp. 247-266, 2007.
[7] K. Okuma, A. Taleghani, N.D. Freitas, J.J. Little, and D.G. Lowe, "A Boosted Particle Filter: Multitarget Detection and Tracking," Proc. European Conf. Computer Vision, 2004.
[8] Z. Khan, T. Balch, and F. Dellaert, "MCMC-Based Particle Filtering for Tracking a Variable Number of Interacting Targets," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 27, no. 11, pp. 1805-1819, Nov. 2005.
[9] Y. Cai, N. de Freitas, and J.J. Little, "Robust Visual Tracking for Multiple Targets," Proc. European Conf. Computer Vision, 2006.
[10] J. Berclaz, F. Fleuret, and P. Fua, "Robust People Tracking with Global Trajectory Optimization," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2006.
[11] Q. Yu, G. Medioni, and I. Cohen, "Multiple Target Tracking Using Spatio-Temporal Markov Chain Monte Carlo Data Association," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2007.
[12] H. Jiang, S. Fels, and J.J. Little, "A Linear Programming Approach for Multiple Object Tracking," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2007.
[13] B. Leibe, K. Schindler, and L.V. Gool, "Coupled Detection and Trajectory Estimation for Multi-Object Tracking," Proc. IEEE Int'l Conf. Computer Vision, 2007.
[14] L. Zhang, Y. Li, and R. Nevatia, "Global Data Association for Multi-Object Tracking Using Network Flows," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2008.
[15] C. Stauffer, "Estimating Tracking Sources and Sinks," Proc. IEEE Workshop Event Mining in Video, 2003.
[16] R. Kaucic, A.G.A. Perera, G. Brooksby, J. Kaufhold, and A. Hoogs, "A Unified Framework for Tracking through Occlusions and across Sensor Gaps," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2005.
[17] A.G.A. Perera, C. Srinivas, A. Hoogs, G. Brooksby, and W. Hu, "Multi-Object Tracking through Simultaneous Long Occlusions and Split-Merge Conditions," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2006.
[18] D. Reid, "An Algorithm for Tracking Multiple Targets," IEEE Trans. Automatic Control, vol. 24, no. 6, pp. 8430-854, Dec. 1979.
[19] Y. Bar-Shalom, T. Fortmann, and M. Scheffe, "Joint Probabilistic Data Association for Multiple Targets in Clutter," Information Sciences and Systems, 1980.
[20] C. Huang, B. Wu, and R. Nevatia, "Robust Object Tracking by Hierarchical Association of Detection Responses," Proc. European Conf. Computer Vision, 2008.
[21] Y. Li, C. Huang, and R. Nevatia, "Learning to Associate: HybridBoosted Multi-Target Tracker for Crowded Scene," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2009.
[22] Caviar Dataset, DATA1 /, 2012.
[23] A.F. Smeaton, P. Over, and W. Kraaij, "Evaluation Campaigns and Trecvid," Proc. Eighth ACM Int'l Workshop Multimedia Information Retrieval, 2006.
[24] H.W. Kuhn, "The Hungarian Method for the Assignment Problem," Naval Research Logistics Quarterly, vol. 2, pp. 83-87, 1955.
[25] D. Heckerman, "A Tractable Inference Algorithm for Diagnosing Multiple Diseases," Proc. Fifth Ann. Conf. Uncertainty in Artificial Intelligence, pp. 163-171, 1989.
[26] L. Mason, J. Baxter, P. Bartlett, and M. Frean, "Boosting Algorithms as Gradient Descent in Function Space," Proc. Advances in Neural Information Processing Systems, 1999.
[27] Y. Freund, R. Iyer, R.E. Schapire, and Y. Singer, "An Efficient Boosting Algorithm for Combining Preferences," J. Machine Learning Research, vol. 4, pp. 933-969, 2003.
[28] C. Huang and R. Nevatia, "High Performance Object Detection by Collaborative Learning of Joint Ranking of Granules Features," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2010.
[29] W. Brendel, M. Amer, and S. Todorovic, "Multiobject Tracking as Maximum-Weight Independent Set," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2011.
[30] J. Berclaz, F. Fleuret, E. Tretken, and P. Fua, "Multiple Object Tracking Using K-Shortest Paths Optimization," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 33, no. 9, pp. 1806-1819, Sept. 2011.
47 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool