• Publication
  • 2003
  • Issue No. 3 - March
  • Abstract - Frame-Rate Spatial Referencing Based on Invariant Indexing and Alignment with Application to Online Retinal Image Registration
 This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Frame-Rate Spatial Referencing Based on Invariant Indexing and Alignment with Application to Online Retinal Image Registration
March 2003 (vol. 25 no. 3)
pp. 379-384

Abstract—This paper describes an algorithm to continually and accurately estimate the absolute location of a diagnostic or surgical tool (such as a laser) pointed at the human retina, from a series of image frames. We treat the problem as a registration problem using diagnostic images to build a spatial map of the retina and then registering each online image against this map. Since the image location where the laser strikes the retina is easily found, this registration determines the position of the laser in the global coordinate system defined by the spatial map. For each online image, the algorithm computes similarity invariants, locally valid despite the curved nature of the retina, from constellations of vascular landmarks. These are detected using a high-speed algorithm that iteratively traces the blood vessel structure. Invariant indexing establishes initial correspondences between landmarks from the online image and landmarks stored in the spatial map. Robust alignment and verification steps extend the similarity transformation computed from these initial correspondences to a global, high-order transformation. In initial experimentation, the method has achieved 100 percent success on 1024 x 1024 retina images. With a version of the tracing algorithm optimized for speed on 512 x 512 images, the computation time is only 51 milliseconds per image on a 900MHz PentiumIII processor and a 97 percent success rate is achieved. The median registration error in either case is about 1 pixel.

[1] S.F. Barrett, M.R. Jerath, H.G. Rylander, and A.J. Welch, “Digital Tracking and Control of Retinal Images,” Optical Eng., vol. 1, no. 33, pp. 150-159, Jan. 1994.
[2] D.E. Becker, A. Can, H.L. Tanenbaum, J.N. Turner, and B. Roysam, “Image Processing Algorithms for Retinal Montage Synthesis, Mapping, and Real-Time Location Determination,” IEEE Trans. Biomedical Eng., vol. 45, no. 1, pp. 105-118, 1998.
[3] J.S. Beis and D.G. Lowe, “Indexing Without Invariants in 3D Object Recognition,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 21, no. 10, pp. 1000-1015, Oct. 1999.
[4] P.J. Besl and N.D. McKay, "A Method for Registration of 3D Shapes," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 14, no. 2, pp. 239-256, Feb. 1992.
[5] T. Binford and T. Levitt, “Quasi-Invariants: Theory and Exploitation,” Proc. DARPA Image Understanding Workshop, pp. 819-829, 1993.
[6] G. Borgefors, “Distance Transforms in Digital Images,” Computer Vision, Graphics, and Image Processing, vol. 34, pp. 344-371, 1986.
[7] A. Can, H. Shen, J. N. Turner, H. L. Tanenbaum, and B. Roysam, “Rapid Automated Tracing and Feature Extraction from Live High-Resolution Retinal Fundus Images Using Direct Exploratory Algorithms,” IEEE Trans. Information Technology for Biomedicine, vol. 3, no. 2, pp. 125-138, 1999.
[8] A. Can, C. Stewart, and B. Roysam, “Robust Hierarchical Algorithm for Constructing a Mosaic from Images of the Curved Human Retina,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 286-292, 1999.
[9] A. Can, C. Stewart, B. Roysam, and H. Tanenbaum, “A Feature-Based Technique for Joint, Linear Estimation of High-Order Image-to-Mosaic Transformations: Application to Mosaicing the Curved Human Retina,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 585-591, 2000.
[10] A. Can, C. Stewart, B. Roysam, and H. Tanenbaum, “A Feature-Based Algorithm for Joint, Linear Estimation of High-Order Image-to-Mosaic Transformations: Mosaicing the Curved Human Retina,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 24, no. 3, pp. 412-419, Mar. 2002.
[11] A. Can, C. Stewart, B. Roysam, and H. Tanenbaum, “A Feature-Based, Robust, Hierarchical Algorithm for Registering Pairs of Images of the Curved Human Retina,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 24, no. 3, pp. 347-364, Mar. 2002.
[12] Y. Chen and G. Medioni, “Object Modeling from Multiple Range Images,” Image and Vision Computing, vol. 10, no. 3, pp. 145-155, Apr. 1992.
[13] S. Fine, “Observations Following Laser Treatment for Choroidal Neovascularization,” Archives of Ophthalmology, vol. 106, pp. 1524-1525, 1988.
[14] F.R. Hampel, P.J. Rousseeuw, E. Ronchetti, and W.A. Stahel, Robust Statistics: The Approach Based on Influence Functions. John Wiley&Sons 1986.
[15] P.W. Holland and R.E. Welsch, “Robust Regression Using Iteratively Reweighted Least-Squares,” Comm. Statistical-Theory Methods, vol. A6, pp. 813-827, 1977.
[16] D. Jacobs, "Matching 3-D models to 2-D Images," Int'l J. Computer Vision. forthcoming
[17] J.M. Krauss and C.A. Puliafito, “Lasers in Ophthalmology,” Lasers In Surgery And Medicine, vol. 17, pp. 102-159, 1995.
[18] S. Kyriacos, F. Nekka, and L. Cartilier, “Insights into the Formation Process of Retinal Vasculature,” Fractals, vol. 5, no. 4, pp. 615-624, 1997.
[19] M.S. Markow, H.G. Rylander, and A.J. Welch, “Real-Time Algorithm for Retinal Tracking,” IEEE Trans. Biomedical Eng., vol. 40, no. 12, pp. 1269-1281, Dec. 1993.
[20] P. Meer, D. Mintz, and A. Rosenfeld, “Robust Regression Methods for Computer Vision: A Review,” Int'l J. Computer Vision, vol. 6, no. 1, pp. 59-70, 1991.
[21] P.N. Monahan, K.A. Gitter, J.D. Eichler, and G. Cohen, “Evaluation of Persistence of Subretinal Neovascular Membranes Using Digitized Angiographic Analysis,” Retina—The J. Retinal and Vitreous Diseases, vol. 13, no. 3, pp. 196-201, 1993.
[22] P.N. Monahan, K.A. Gitter, J.D. Eichler, G. Cohen, and K. Schomaker, “Use of Digitized Fluorescein Angiogram System to Evaluate Laser Treatment for Subretinal Neovascularization: Technique,” Retina—J. Retinal and Vitreous Diseases, vol. 13, no. 3, pp. 187-195, 1993.
[23] R. Murphy, “Age-Related Macular Degeneration,” Ophthalmology, vol. 9, pp. 696-971, 1986.
[24] Research to Prevent Blindness Foundation, RPB: Research to Prevent Blindness Ann. Report, 598 Madison Avenue, New York, NY 10022, 1992.
[25] J. Roider and H. Laqua, “Laser Coagulation of Age-Related Macular Degeneration,” Klinische Monatsblatter Fur Augenheilkunde, vol. 206, pp. 428-437, June 1995.
[26] C. Rothwell, A. Zisserman, D. Forsyth, and J. Mundy, “Planar Object Recognition Using Projective Shape Representation,” Int'l J. Computer Vision, vol. 16, no. 1, pp. 57-99, 1995.
[27] I. Sel, Detection Theory. Princeton Univ. Press, 1965.
[28] H. Shen, “Indexing Based Frame-Rate Spatial Referencing Algorithms: Application to Laser Retinal Surgery,” PhD thesis, Rensselaer Polytechnic Inst., 2000.
[29] H. Shen, B. Roysam, C. Stewart, J. Turner, and H. Tanenbaum, “Optimal Scheduling of Tracing Computations for Real-Time Vascular Landmark Extraction from retinal Fundus Images,” IEEE Trans. Information Technology in Biomedicine, vol. 5, no. 1, pp. 77-91, Mar. 2001.
[30] C.V. Stewart, “Robust Parameter Estimation in Computer Vision,” SIAM Review, vol. 41, no. 3, pp. 513-537, 1999.
[31] C.-L. Tsai, C. Stewart, B. Roysam, and H. Tanenbaum, “Repeatable Vascular Landmark Extraction from Retinal Fundus Images Using Local Vascular Traces,” IEEE Trans. Information Technology in Biomedicine, submitted 2001.
[32] I.E. Zimmergaller, N.M. Bressler, and S.B. Bressler, “Treatment of Choroidal Neovascularization—Updated Information from Recent Macular Photocoagulation Study Group Reports,” Int'l Ophthalmology Clinics, vol. 35, pp. 37-57, 1995.
[33] A. Zisserman, D. Forsyth, J. Mundy, C. Rothwell, J. Liu, and N. Pillow, “3D Object Recognition Using Invariance,” Artificial Intelligence, vol. 78, nos. 1-2, pp. 239-288, 1995.

Index Terms:
Retinal laser surgery, registration, invariant indexing, robust estimation, retinal imaging, ophthalmic image processing, biomedical image processing.
Citation:
Hong Shen, Charles V. Stewart, Badrinath Roysam, Gang Lin, Howard L. Tanenbaum, "Frame-Rate Spatial Referencing Based on Invariant Indexing and Alignment with Application to Online Retinal Image Registration," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 25, no. 3, pp. 379-384, March 2003, doi:10.1109/TPAMI.2003.1182101
Usage of this product signifies your acceptance of the Terms of Use.