This Article 
 Bibliographic References 
 Add to: 
Registration Based on Projective Reconstruction Technique for Augmented Reality Systems
May/June 2005 (vol. 11 no. 3)
pp. 254-264
In AR systems, registration is one of the most difficult problems currently limiting their application. In this paper, we propose a simple registration method using projective reconstruction. This method consists of two steps: embedding and tracking. Embedding involves specifying four points to build the world coordinate system on which a virtual object will be superimposed. In tracking, a projective reconstruction technique is used to track these four specified points to compute the model view transformation for augmentation. This method is simple, as only four points need to be specified at the embedding stage and the virtual object can then be easily augmented onto a real scene from a video sequence. In addition, it can be extended to a scenario using the projective matrix that has been obtained from previous registration results using the same AR system. The proposed method has three advantages: 1) It is fast because the linear least square method can be used to estimate the related matrix in the algorithm and it is not necessary to calculate the fundamental matrix in the extended case. 2) A virtual object can still be superimposed on a related area even if some parts of the specified area are occluded during the whole process. 3) This method is robust because it remains effective even when not all the reference points are detected during the whole process, as long as at least six pairs of related reference points correspondences can be found. Some experiments have been conducted to validate the performance of the proposed method.

[1] H. Kato and M. Billinghurst, “Marker Tracking and HMD Calibration for a Video-Based Augmented Reality Conferencing System,” Proc. Second IEEE and ACM Int'l Workshop Augmented Reality, pp. 85-94, 1999.
[2] Y.D. Seo and K.S. Hong, “Calibration-Free Augmented Reality in Perspective,” IEEE Trans. Visualization and Computer Graphics, vol. 6, no. 4, pp. 346-359, 2000.
[3] S.J.D. Prince, K. Xu, and A.D. Cheok, “Augmented Reality Camera Tracking with Homographies,” IEEE Computer Graphics and Applications, vol. 22, no. 6, pp. 39-45, Nov./Dec. 2002.
[4] G. Simon and M.O. Berger, “Pose Estimation for Planar Structure,” IEEE Computer Graphics and Applications, vol. 22, no. 6, pp. 46-453, Nov./Dec. 2002.
[5] N. Kiriakos and J.R. Vallino, “Calibration-Free Augmented Reality,” IEEE Trans. Visualization and Computer Graphics, vol. 4, no. 1, pp. 1-20, Jan.-Mar. 1998.
[6] R.I. Hartley, “Projective Reconstruction and Invariant from Multiple Images,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 16, no. 10, pp. 1036-1040, Oct. 1994.
[7] R. Vijaimukund, J. Molineros, and R. Sharma, “Interactive Evaluation of Assembly Sequence Using Augmented Reality,” IEEE Trans. Robotics and Automation, vol. 15, no. 3, pp. 435-449, 1999.
[8] K. Satoh, M. Anabuki, H. Yamamoto, and H. Tamura, “A Hybrid Registration Method for Outdoor Augmented Reality,” Proc. IEEE and ACM Int'l Symp. Augmented Reality, pp. 67-76, 2001.
[9] J. Rekimoto, “Matrix: A Real-Time Object Identification and Registration Method for Augmented Reality,” Proc. Third Asia Pacific Conf. Computer-Human Interactions, pp. 63-68, 1998.
[10] M. Rosenthal, A. State, J.H. Lee, G. Hirota, J. Ackerman, K. Keller, E.D. Pisano, M. Jiroutek, K. Muller, and H. Fuchs, “Augmented Reality Guidance for Needle Biopsies: An Initial Randomized, Controlled Trial in Phantoms,” Medical Image Analysis, vol. 6, no. 3, pp. 313-320, 2002.
[11] S. Julier, M. Lanzagorta, Y. Baillot, L. Rosenblum, and S. Feiner, “Information Filtering for Mobile Augmented Reality,” Proc. Int'l Symp. Augmented Reality 2000, pp. 3-11, 2000.
[12] M. Utsumi, “Development for Teleoperation Underwater Grasping System in Unclear Environment,” Proc. 2002 Int'l Symp. Underwater Technology, pp. 349-353, 2002.
[13] B. MacIntyre, M. Lohse, J.D. Bolter, and E. Moreno, “Integrating 2-D Video Actors into 3-D Augmented-Reality Systems,” Presence, vol. 11, no. 2, pp. 189-20, 2002.
[14] S. Feiner, B. MacIntyre, and D. Seligmann, “Knowledge-Based Augmented Reality,” Comm. ACM, vol. 36, no. 7, pp. 52-62, 1993.
[15] W. Barfield, K. Baird, J. Shewchuk, and G. Ioannou, “Applications of Wearable Computers and Augmented Reality to Manufacturing,” Fundamentals of Wearable Computers and Augmented Reality, W. Barfield and T. Caudell, eds., pp. 695-724, Lawrence Erlbaum, 2001.
[16] R.T. Azuma, “A Survey of Augmented Reality,” Presence: Teleoperators and Virtual Environments, vol. 6, no. 4, pp. 355-385, 1997.
[17] R. Azuma, Y. Baillot, R. Behringer, S. Feiner, S. Julier, and B. MacIntyre, “Recent Advances in Augmented Reality,” IEEE Computer Graphics and Applications, vol. 21, no. 6, pp. 34-47, Nov./Dec. 2001.
[18] R. Behringer, “Registration for Outdoor Augmented Reality Applications Using Computer Vision Techniques and Hybrid Sensors,” Proc. Virtual Reality Ann. Int'l Symp., pp. 244-251, 1999.
[19] W.A. Ho, K. Nguyen, and T. Lyon, “Computer Vision-Based Registration Techniques for Augmented Reality,” Proc. Intelligent Robots and Computer Vision XV, pp. 538-548, 1996.
[20] S.J. Maybank and O. Faugeras, “A Theory of Self-Calibration of a Moving Camera,” Int'l J. Computer Vision, vol. 8, no. 2, pp. 123-151, 1992.
[21] C.S. Chen, C.K. Yu, and Y.P. Hung, “New Calibration-Free Approach for Augmented Reality Based on Parameterized Cuboid Structure,” Proc. Seventh Int'l Conf. Computer Vision, pp. 30-37, 1999.
[22] Z. Zhang, R. Deriche, O. Faugeras, and Q.T. Luong, “A Robust Technique for Matching Two Uncalibrated Images through the Recovery of the Unknown Epipolar Geometry,” Artificial Intelligence J., vol. 78, pp. 87-119, 1995.
[23] R.I. Hartley, “In Defense of the Eight-Point Algorithm,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 19, no. 6, pp. 580-593, June 1997.
[24] Z. Zhang, “Determining the Epipolar Geometry and Its Uncertainty: A Review,” Int'l J. Computer Vision, vol. 27, no. 2, pp. 161-198, 1998.
[25] C. Harris and M. Stephens, “A Combined Corner and Edge Detector,” Proc. Second Alvey Vision Conf., pp. 189-192, 1988.

Index Terms:
Augmented reality, registration, projective reconstruction, tracking.
M.L. Yuan, S.K. Ong, A.Y.C. Nee, "Registration Based on Projective Reconstruction Technique for Augmented Reality Systems," IEEE Transactions on Visualization and Computer Graphics, vol. 11, no. 3, pp. 254-264, May-June 2005, doi:10.1109/TVCG.2005.48
Usage of this product signifies your acceptance of the Terms of Use.