Subscribe
Issue No.11 - November (2011 vol.17)
pp: 1728-1735
Youngmin Park , Gwangju Institute of Science and Technology, Gwangju
Vincent Lepetit , EPFL/IC/ISIM/CVLab, Lausanne
Woontack Woo , Gwangju Institute of Science and Technology, Gwangju
ABSTRACT
We present a method that is able to track several 3D objects simultaneously, robustly, and accurately in real time. While many applications need to consider more than one object in practice, the existing methods for single object tracking do not scale well with the number of objects, and a proper way to deal with several objects is required. Our method combines object detection and tracking: frame-to-frame tracking is less computationally demanding but is prone to fail, while detection is more robust but slower. We show how to combine them to take the advantages of the two approaches and demonstrate our method on several real sequences.
INDEX TERMS
Augmented reality, computer vision, object tracking, object detection.
CITATION
Youngmin Park, Vincent Lepetit, Woontack Woo, "Extended Keyframe Detection with Stable Tracking for Multiple 3D Object Tracking", IEEE Transactions on Visualization & Computer Graphics, vol.17, no. 11, pp. 1728-1735, November 2011, doi:10.1109/TVCG.2010.262
REFERENCES
 [1] V. Lepetit and P. Fua, “Monocular Model-Based 3D Tracking of Rigid Objects,” Foundations and Trends in Computer Graphics and Vision, vol. 1, no. 1, pp. 1-89, 2005. [2] M. Ozuysal, M. Calonder, V. Lepetit, and P. Fua, “Fast Keypoint Recognition Using Random Ferns,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 32, no. 3, pp. 448-461, Mar. 2010. [3] G. Klein and D. Murray, “Parallel Tracking and Mapping for Small AR Workspaces,” Proc. Int'l Symp. Mixed and Augmented Reality, Nov. 2007. [4] L. Vacchetti, V. Lepetit, and P. Fua, “Stable Real-Time 3D Tracking Using Online and Offline Information,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 26, no. 10, pp. 1391-1402, Oct. 2004. [5] Y. Park, V. Lepetit, and W. Woo, “Multiple 3D Object Tracking for Augmented Reality,” Proc. Int'l Symp. Mixed and Augmented Reality, Sept. 2008. [6] D. Reid, “An Algorithm for Tracking Multiple Targets,” IEEE Trans. Automatic Control, vol. 24, no. 6, pp. 843-854, Dec. 1979. [7] S. Oh, S. Russell, and S. Sastry, “Markov Chain Monte Carlo Data Association for General Multiple-Target Tracking Problems,” Proc. IEEE Conf. Decision and Control, Dec. 2004. [8] D. Wagner, G. Reitmayr, A. Mulloni, T. Drummond, and D. Schmalstieg, “Pose Tracking from Natural Features on Mobile Phones,” Proc. Int'l Symp. Mixed and Augmented Reality, Sept. 2008. [9] I. Skrypnyk and D. Lowe, “Scene Modelling, Recognition and Tracking with Invariant Image Features,” Proc. Int'l Symp. Mixed and Augmented Reality, Nov. 2004. [10] D. Lowe, “Distinctive Image Features from Scale-Invariant Keypoints,” Int'l J. Computer Vision, vol. 60, no. 2, pp. 91-110, 2004. [11] H. Bay, A. Ess, T. Tuytelaars, and L. Van Gool, “SURF: Speeded Up Robust Features,” Computer Vision and Image Understanding, vol. 110, no. 3, pp. 346-359, 2008. [12] T. Drummond and R. Cipolla, “Real-Time Visual Tracking of Complex Structures,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 24, no. 7, pp. 932-946, July 2002. [13] A. Comport, E. Marchand, M. Pressigout, and F. Chaumette, “Real-Time Markerless Tracking for Augmented Reality: The Virtual Visual Servoing Framework,” IEEE Trans. Visualization and Computer Graphics, vol. 12, no. 4, pp. 615-628, July 2006. [14] S. Taylor and T. Drummond, “Multiple Target Localisation at over 100 FPS,” Proc. British Machine Vision Conf., Sept. 2009. [15] D. Wagner, D. Schmalstieg, and H. Bischof, “Multiple Target Detection and Tracking with Guaranteed Framerates on Mobile Phones,” Proc. Int'l Symp. Mixed and Augmented Reality, Oct. 2009. [16] J. Pilet and H. Saito, “Virtually Augmenting Hundreds of Real Pictures: An Approach Based on Learning, Retrieval, and Tracking,” Proc. IEEE Virtual Reality, Mar. 2010. [17] V. Lepetit, F. Moreno-Noguer, and P. Fua, “EP$n$ P: An Accurate O(n) Solution to the P$n$ P Problem,” Int'l J. Computer Vision, vol. 81, no. 2, pp. 155-166, Feb. 2009. [18] C. Tomasi and T. Kanade, “Detection and Tracking of Point Features,” technical report, Carnegie Mellon Univ., Apr. 1991. [19] T. Lee and T. Hollerer, “Multithreaded Hybrid Feature Tracking for Markerless Augmented Reality,” IEEE Trans. Visualization and Computer Graphics, vol. 15, no. 3, pp. 355-368, May 2009. [20] D. Nister and H. Stewenius, “Scalable Recognition with a Vocabulary Tree,” Proc. Conf. Computer Vision and Pattern Recognition, pp. 2161-2168, Oct. 2006.