Issue No. 10 - October (2011 vol. 17)
DOI Bookmark: http://doi.ieeecomputersociety.org/10.1109/TVCG.2010.241
Mark Billinghurst , University of Canterbury, New Zealand
Nate Hagbi , Ben-Gurion University, Israel
Oriel Bergig , Ben-Gurion University, Israel
Jihad El-Sana , Ben-Gurion University, Israel
Nestor is a real-time recognition and camera pose estimation system for planar shapes. The system allows shapes that carry contextual meanings for humans to be used as Augmented Reality (AR) tracking targets. The user can teach the system new shapes in real time. New shapes can be shown to the system frontally, or they can be automatically rectified according to previously learned shapes. Shapes can be automatically assigned virtual content by classification according to a shape class library. Nestor performs shape recognition by analyzing contour structures and generating projective-invariant signatures from their concavities. The concavities are further used to extract features for pose estimation and tracking. Pose refinement is carried out by minimizing the reprojection error between sample points on each image contour and its library counterpart. Sample points are matched by evolving an active contour in real time. Our experiments show that the system provides stable and accurate registration, and runs at interactive frame rates on a Nokia N95 mobile phone.
Multimedia information systems, artificial, augmented, and virtual realities, image processing and computer vision, scene analysis, tracking.
Mark Billinghurst, Nate Hagbi, Oriel Bergig, Jihad El-Sana, "Shape Recognition and Pose Estimation for Mobile Augmented Reality", IEEE Transactions on Visualization & Computer Graphics, vol. 17, no. , pp. 1369-1379, October 2011, doi:10.1109/TVCG.2010.241