The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.10 - Oct. (2013 vol.35)
pp: 2427-2441
Junseok Kwon , Dept. of Electr. Eng. & Comput. Sci., Seoul Nat. Univ., Seoul, South Korea
Kyoung Mu Lee , Dept. of Electr. Eng. & Comput. Sci., Seoul Nat. Univ., Seoul, South Korea
ABSTRACT
A novel tracking algorithm is proposed for targets with drastically changing geometric appearances over time. To track such objects, we develop a local patch-based appearance model and provide an efficient online updating scheme that adaptively changes the topology between patches. In the online update process, the robustness of each patch is determined by analyzing the likelihood landscape of the patch. Based on this robustness measure, the proposed method selects the best feature for each patch and modifies the patch by moving, deleting, or newly adding it over time. Moreover, a rough object segmentation result is integrated into the proposed appearance model to further enhance it. The proposed framework easily obtains segmentation results because the local patches in the model serve as good seeds for the semi-supervised segmentation task. To solve the complexity problem attributable to the large number of patches, the Basin Hopping (BH) sampling method is introduced into the tracking framework. The BH sampling method significantly reduces computational complexity with the help of a deterministic local optimizer. Thus, the proposed appearance model could utilize a sufficient number of patches. The experimental results show that the present approach could track objects with drastically changing geometric appearance accurately and robustly.
INDEX TERMS
Target tracking, Topology, Robustness, Computational modeling, Adaptation models, Sampling methods, Proposals,likelihood landscape analysis, Object tracking, nonrigid object, local patch-based appearance model, Basin Hopping Sampling, Markov Chain Monte Carlo
CITATION
Junseok Kwon, Kyoung Mu Lee, "Highly Nonrigid Object Tracking via Patch-Based Dynamic Appearance Modeling", IEEE Transactions on Pattern Analysis & Machine Intelligence, vol.35, no. 10, pp. 2427-2441, Oct. 2013, doi:10.1109/TPAMI.2013.32
REFERENCES
[1] A. Yilmaz, O. Javed, and M. Shah, "Object Tracking: A Survey," ACM Computing Surveys, vol. 38, no. 4,article 13, 2006.
[2] S. Avidan, "Ensemble Tracking," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 29, no. 2, pp. 261-271, Feb. 2007.
[3] B. Babenko, M. Yang, and S. Belongie, "Visual Tracking with Online Multiple Instance Learning," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2009.
[4] R. Collins, Y. Liu, and M. Leordeanu, "Online Selection of Discriminative Tracking Features," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 27, no. 10, pp. 1631-1643, Oct. 2005.
[5] H. Grabner and H. Bischof, "On-Line Boosting and Vision," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2006.
[6] B. Han and L. Davis, "On-Line Density-Based Appearance Modeling for Object Tracking," Proc. 10th IEEE Int'l Conf. Computer Vision, 2005.
[7] A.D. Jepson, D.J. Fleet, and T.F.E. Maraghi, "Robust Online Appearance Models for Visual Tracking," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 25, no. 10, pp. 1296-1311, Oct. 2003.
[8] Z. Kalal, K. Mikolajczyk, and J. Matas, "Tracking-Learning-Detection," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 34, no. 7, pp. 1409-1422, July 2012.
[9] J. Kwon and K.M. Lee, "Tracking of a Non-Rigid Object via Patch-Based Dynamic Appearance Modeling and Adaptive Basin Hopping Monte Carlo Sampling," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2009.
[10] D.A. Ross, J. Lim, R. Lin, and M. Yang, "Incremental Learning for Robust Visual Tracking," Int'l J. Computer Vision, vol. 77, nos. 1-3, pp. 125-141, 2008.
[11] M. Yang and Y. Wu, "Tracking Non-Stationary Appearances and Dynamic Feature Selection," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2005.
[12] S. Wang, H. Lu, F. Yang, and M.-H. Yang, "Superpixel Tracking," Proc. IEEE Int'l Conf. Computer Vision, 2011.
[13] D. Comaniciu, V. Ramesh, and P. Meer, "Real-Time Tracking of Non-Rigid Objects Using Mean Shift," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2000.
[14] P. Perez, C. Hue, J. Vermaak, and M. Gangnet, "Color-Based Probabilistic Tracking," Proc. Seventh European Conf. Computer Vision, 2002.
[15] C. Bibby and I. Reid, "Robust Real-Time Visual Tracking Using Pixel-Wise Posteriors," Proc. European Conf. Computer Vision, 2008.
[16] D. Crandall, P. Felzenszwal, and D. Huttenlocher, "Spatial Priors for Part-Based Recognition Using Statistical Models," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2005.
[17] R. Fergus, P. Perona, and A. Zisserman, "A Sparse Object Category Model for Efficient Learning and Exhaustive Recognition," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2005.
[18] B. Leibe, K. Schindler, N. Cornelis, and L. Van Gool, "Coupled Object Detection and Tracking from Static Cameras and Moving Vehicles," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 30, no. 10, pp. 1683-1698, Oct. 2008.
[19] B.D. Lucas and T. Kanade, "An Iterative Image Registration Technique with an Application to Stereo Vision," Proc. Seventh Int'l Joint Conf. Artificial Intelligenc, 1981.
[20] G. Schindler and F. Dellaert, "A Rao-Blackwellized Parts-Constellation Tracker," Proc. IEEE Int'l Conf. Computer Vision Workshop, 2005.
[21] D. Ramanan, D. Forsyth, and A. Zisserman, "Tracking People by Learning Their Appearance," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 29, no. 1, pp. 65-81, Jan. 2007.
[22] T. Zhao and R. Nevatia, "Tracking Multiple Humans in Crowded Environment," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2004.
[23] L. Cehovin, M. Kristan, and A. Leonardis, "An Adaptive Coupled-Layer Visual Model for Robust Visual Tracking," Proc. IEEE Int'l Conf. Computer Vision, 2011.
[24] M. Godec, P.M. Roth, and H. Bischof, "Hough-Based Tracking of Non-Rigid Objects," Proc. IEEE Int'l Conf. Computer Vision, 2011.
[25] A. Adam, E. Rivlin, and I. Shimshoni, "Robust Fragments-Based Tracking Using the Integral Histogram," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2006.
[26] S.M.S. Nejhum, J. Ho, and M.-H. Yang, "Visual Tracking with Histograms and Articulating Blocks," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2008.
[27] M. Yang, J. Yuan, and Y. Wu, "Spatial Selection for Attentional Visual Tracking," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2007.
[28] P. Chockalingam, N. Pradeep, and S. Birchfield, "Adaptive Fragments-Based Tracking of Non-Rigid Objects using Level Sets," Proc. 12th IEEE Int'l Conf. Computer Vision, 2009.
[29] L. Lu and G.D. Hager, "A Nonparametric Treatment for Location/Segmentation Based Visual Tracking," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2007.
[30] M. Isard and A. Blake, "Icondensation: Unifying Low-Level and High-Level Tracking in a Stochastic Framework," Proc. Fifth European Conf. Computer Vision, 1998.
[31] Z. Khan, T. Balch, and F. Dellaert, "MCMC-Based Particle Filtering for Tracking a Variable Number of Interacting Targets," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 27, no. 11, pp. 1805-1819, Nov. 2005.
[32] K. Smith, D.G. Perez, and J. Odobez, "Using Particles to Track Varying Numbers of Interacting People," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2005.
[33] W. Hastings, "Monte Carlo Sampling Methods Using Markov Chains and Their Applications," Biometrika, vol. 57, pp. 97-109, 1970.
[34] L. Matthews, T. Ishikawa, and S. Baker, "The Template Update Problem," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 26, no. 6, pp. 810-815, June 2004.
[35] T.H. Kim, K.M. Lee, and S.U. Lee, "Generative Image Segmentation Using Random Walks with Restart," Proc. 10th European Conf. Computer Vision, 2008.
[36] L. Zhan, B. Piwowar, W.K. Liu, P.J. Hsu, S.K. Lai, and J.Z.Y. Chen, "Multicanonical Basin Hopping: A New Global Optimization Method for Complex Systems," J. Chemical Physics, vol. 120, no. 12, pp. 5536-5542, 2004.
[37] S. Hare, A. Saffari, and P.H.S. Torr, "Struck: Structured Output Tracking with Kernels," Proc. IEEE Int'l Conf. Computer Vision, 2011.
[38] A. Saffari, M. Godec, T. Pock, C. Leistner, and H. Bischof, "Online Multi-Class Lpboost," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2010.
[39] R. Collins, "Mean-Shift Blob Tracking through Scale Space," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2003.
[40] R.M. Neal, "Annealed Importance Sampling," Technical Report No. 9805, Dept. of Statistics, Univ. of Toronto, 1998.
[41] B. Berg, "Introduction to Markov Chain Monte Carlo Simulations and Their Statistical Analysis," Phys. Stat. Mech., 2004.
[42] K. Hamacher and W. Wenzel, "The Scaling Behaviour of Stochastic Minimization Algorithms in a Perfect Funnel Landscape," Physical Rev. E, vol. 59, no. 1, pp. 938-941, 1999.
[43] T. Herges, A. Schug, H. Merlitz, and W. Wenzel, "Stochastic Optimization Methods for Structure Prediction of Biomolecular Nanoscale Systems," Nanotechnology, vol. 14, pp. 1161-1167, 2003.
[44] M. Everingham, L.V. Gool, C.K.I. Williams, J. Winn, and A. Zisserman, "The Pascal Visual Object Classes (VOC) Challenge," Int'l J. Computer Vision, vol. 88, no. 2, pp. 303-308, 2009.
72 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool