• Publication
  • 2002
  • Issue No. 3 - March
  • Abstract - A Feature-Based Technique for Joint Linear Estimation of High-Order Image-to-Mosaic Transformations: Mosaicing the Curved Human Retina
 This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
A Feature-Based Technique for Joint Linear Estimation of High-Order Image-to-Mosaic Transformations: Mosaicing the Curved Human Retina
March 2002 (vol. 24 no. 3)
pp. 412-419

An algorithm for constructing image mosaics from multiple, uncalibrated, weak-perspective views of the human retina is presented and analyzed. It builds on a previously described algorithm for registering pairs of retinal images using a noninvertible, 12-parameter, quadratic image transformation model and a hierarchical, robust estimation technique. The major innovation presented here is a linear, feature-based, noniterative method for jointly estimating consistent transformations of all images onto the mosaic “anchor image.” Constraints for this estimation are derived from pairwise registration both directly with the anchor image and indirectly between pairs of nonanchor images. An incremental, graph-based technique constructs the set of registered image pairs used in the joint solution. The joint estimation technique allows images that do not overlap the anchor frame to be successfully mosaiced, a particularly valuable capability for mosaicing images of the retinal periphery. Experimental analysis of the algorithm on data sets from 16 eyes shows the average overall median transformation error in final mosaic construction to be 0.76 pixels. Overall, the technique is simpler, more accurate, and offers broader coverage than previously published methods.

[1] D.E. Becker, A. Can, H.L. Tanenbaum, J.N. Turner, and B. Roysam, “Image Processing Algorithms for Retinal Montage Synthesis, Mapping, and Real-Time Location Determination,” IEEE Trans. Biomedical Eng., vol. 45, no. 1, pp. 105-118, 1998.
[2] J.R. Bergen, P. Anandan, K.J. Hanna, and R. Hingorani, “Hiercharchical Model-Based Motion Estimation,” Proc. European Conf. Computer Vision, pp. 237-252, 1992.
[3] J.W. Berger and D.S. Shin, “Computer Vision Enabled Augmented Reality Fundus Biomicroscopy,” Ophthalmology, vol. 106, no. 10, pp. 1935–1941 Oct. 1999.
[4] A. Can, H. Shen, J. N. Turner, H. L. Tanenbaum, and B. Roysam, “Rapid Automated Tracing and Feature Extraction from Live High-Resolution Retinal Fundus Images Using Direct Exploratory Algorithms,” IEEE Trans. Information Technology for Biomedicine, vol. 3, no. 2, pp. 125-138, 1999.
[5] A. Can, C. Stewart, and B. Roysam, “Robust Hierarchical Algorithm for Constructing a Mosaic from Images of the Curved Human Retina,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 286-292, 1999.
[6] A. Can, C. Stewart, B. Roysam, and H. Tanenbaum, “A Feature-Based, Robust, Hierarchical Algorithm for Registering Pairs of Images of the Curved Human Retina,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 24, no. 3, pp. 347-364, Mar. 2002.
[7] D. Capel and A. Zisserman, “Automated Mosaicing with Super-Resolution Zoom,” Proc. IEEE Computer Vision and Pattern Recognition, pp. 885-891, 1998.
[8] S.E. Chen, "QuickTime VR—An Image-Based Approach to Virtual Environment Navigation," Siggraph 95 Conf. Proc., ACM Press, New York, 1995, pp. 29-38.
[9] P. Dani and S. Chaudhuri, “Automated Assembling of Images—Image Montage Preparation,” Pattern Recognition, vol. 28, no. 1, pp. 431–445, Mar. 1995.
[10] J. Davis, Mosaics of Scenes with Moving Objects IEEE CS Conf. Computer Vision and Pattern Recognition, pp. 354-360, June 1998.
[11] N. Gracias and J. Santos-Victor, “Underwater Video Mosaics as Visual Navigation Maps,” Computer Vision and Image Understanding, vol. 79, no. 1, pp. 66–91, 1999.
[12] F.R. Hampel, P.J. Rousseeuw, E. Ronchetti, and W.A. Stahel, Robust Statistics: The Approach Based on Influence Functions. John Wiley&Sons, 1986.
[13] P.W. Holland and R.E. Welsch, “Robust Regression Using Iteratively Reweighted Least-Squares,” Comm. Statistical Theoretic Methethods, vol. A6, pp. 813–827, 1977.
[14] M. Irani and P. Anandan, Video Indexing Based on Mosaic Representations IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 86, no. 5, pp. 905-921, 1998.
[15] M. Irani, P. Anandan, and S. Hsu, “Mosaic Based Representations of Video Sequences and Their Applications,” Proc. Fifth Int'l Conf. Computer Vision, pp. 605-611, June 1995.
[16] A.A. Mahurkar, M.A. Vivino, B.L. Trus, E. M. Kuehl, M.B. Datiles, and M.I. Kaiser-Kupfer, “Constructing Retinal Fundus Photomontages,” Investigative Ophthalmology and Visual Science, vol. 37, no. 8, pp. 1675–1683, July 1996.
[17] D. Milgram, “Computer Methods for Creating Photomosaics,” IEEE Trans. Computers, vol. 23, pp. 1113–1119, 1975.
[18] D. Milgram, “Adaptive Techniques for Photomosaicking,” IEEE Trans. Computers, vol. 26, pp. 1175–1180, 1977.
[19] Geometric Invariance in Computer Vision, J. Mundy and A. Zisserman, eds., MIT Press, 1992.
[20] S. Peleg, “Elimination of Seams from Photomosaics,” Proc. Int'l Conf. Color in Graphics and Image Processing, vol. 16, no. 1, pp. 90–94, 1981.
[21] S. Peleg and M. Ben-Ezra, Stereo Panorama with a Single Camera Proc. IEEE Conf. Computer Vision and Pattern Recognition (CVPR '99), pp. 395-401, 1999.
[22] S. Peleg and J. Herman, “Panoramic Mosaics by Manifold Projection,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 338-343, June 1997.
[23] P.J. Rousseeuw, “Least Median of Squares Regression,” J. Am. Statistical Assoc., vol. 79, pp. 871–880, 1984.
[24] H. Sawhney, S. Hsu, and R. Kumar, “Robust Video Mosaicing through Topology Inference and Local to Global Alignment,” Proc. Fifth European Conf. Computer Vision, vol. II, pp. 103-119, 1998.
[25] H. Shen, B. Roysam, C. Stewart, J. Turner, and H. Tanenbaum, “Optimal Scheduling of Tracing Computations for Real-Time Vascular Landmark Extraction from retinal Fundus Images,” IEEE Trans. Information Technology in Biomedicine, vol. 5, no. 1, pp. 77-91, Mar. 2001.
[26] H.Y. Shum and R. Szeliski, “Construction of Panoramic Image Mosaics with Global and Local Alignment,” Int'l J. Computer Vision, vol. 36, no. 2, pp. 101-130, Feb. 2000.
[27] H.-Y. Shum and R. Szeliski, “Construction and Refinement of Panoramic Mosaics with Global and Local Alignment,” Proc. IEEE Int'l Conf. Computer Vision, pp. 953-958, 1998.
[28] R. Szeliski, “Video Mosaics for Virtual Environments,” IEEE Computer Graphics and Applications, pp. 22-30, Mar. 1996.
[29] M. Tanaka, S. Tamura, and K. Tanaka, “On Assembling Subpictures into a Mosaic Picture,” IEEE Trans. Systems, Man, and Cybernetics, vol. 7, pp. 42–48, 1977.
[30] J. Um and R. Wright, “Video Strip Mosaicking: A Two-Dimensional Approach by Convergent Image Bridging,” Int'l J. Remote Sensing, vol. 20, no. 10, p. 2015, July 1999.
[31] A. Zappala, A. Gee, and M. Taylor, “Document Mosaicing,” Image and Vision Computing, vol. 17, no. 8, pp. 589–595, 1999.

Index Terms:
robust estimation, image mosaic, image montage, transformation estimation, retinal imaging, joint estimation
Citation:
A. Can, C.V. Stewart, B. Roysam, H.L. Tanenbaum, "A Feature-Based Technique for Joint Linear Estimation of High-Order Image-to-Mosaic Transformations: Mosaicing the Curved Human Retina," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 24, no. 3, pp. 412-419, March 2002, doi:10.1109/34.990145
Usage of this product signifies your acceptance of the Terms of Use.