Issue No. 03 - May/June (2010 vol. 16)
DOI Bookmark: http://doi.ieeecomputersociety.org/10.1109/TVCG.2009.99
Dieter Schmalstieg , Graz University of Technology, Graz
Tom Drummond , University of Cambridge, Cambridge
Alessandro Mulloni , Graz University of Technology, Graz
Gerhard Reitmayr , Cambridge University, Cambridge
Daniel Wagner , Graz University of Technology, Graz
In this paper, we present three techniques for 6DOF natural feature tracking in real time on mobile phones. We achieve interactive frame rates of up to 30 Hz for natural feature tracking from textured planar targets on current generation phones. We use an approach based on heavily modified state-of-the-art feature descriptors, namely SIFT and Ferns plus a template-matching-based tracker. While SIFT is known to be a strong, but computationally expensive feature descriptor, Ferns classification is fast, but requires large amounts of memory. This renders both original designs unsuitable for mobile phones. We give detailed descriptions on how we modified both approaches to make them suitable for mobile phones. The template-based tracker further increases the performance and robustness of the SIFT- and Ferns-based approaches. We present evaluations on robustness and performance and discuss their appropriateness for Augmented Reality applications.
Information interfaces and presentation, multimedia information systems, artificial, augmented, and virtual realities, image processing and computer vision, scene analysis, tracking.
Dieter Schmalstieg, Tom Drummond, Alessandro Mulloni, Gerhard Reitmayr, Daniel Wagner, "Real-Time Detection and Tracking for Augmented Reality on Mobile Phones", IEEE Transactions on Visualization & Computer Graphics, vol. 16, no. , pp. 355-368, May/June 2010, doi:10.1109/TVCG.2009.99