The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.11 - November (2011 vol.33)
pp: 2245-2258
Li Tang , University of Iowa, Iowa City
Mona K. Garvin , University of Iowa, Iowa City
Kyungmoo Lee , University of Iowa, Iowa City
Wallace L.M. Alward , University of Iowa, Iowa City
Young H. Kwon , University of Iowa, Iowa City
Michael D. Abràmoff , University of Iowa, Iowa City
ABSTRACT
A robust multiscale stereo matching algorithm is proposed to find reliable correspondences between low contrast and weakly textured retinal image pairs with radiometric differences. Existing algorithms designed to deal with piecewise planar surfaces with distinct features and Lambertian reflectance do not apply in applications such as 3D reconstruction of medical images including stereo retinal images. In this paper, robust pixel feature vectors are formulated to extract discriminative features in the presence of noise in scale space, through which the response of low-frequency mechanisms alter and interact with the response of high-frequency mechanisms. The deep structures of the scene are represented with the evolution of disparity estimates in scale space, which distributes the matching ambiguity along the scale dimension to obtain globally coherent reconstructions. The performance is verified both qualitatively by face validity and quantitatively on our collection of stereo fundus image sets with ground truth, which have been made publicly available as an extension of standard test images for performance evaluation.
INDEX TERMS
Depth from stereo, radiometric differences, pixel feature vector, fundus image, scale space.
CITATION
Li Tang, Mona K. Garvin, Kyungmoo Lee, Wallace L.M. Alward, Young H. Kwon, Michael D. Abràmoff, "Robust Multiscale Stereo Matching from Fundus Images with Radiometric Differences", IEEE Transactions on Pattern Analysis & Machine Intelligence, vol.33, no. 11, pp. 2245-2258, November 2011, doi:10.1109/TPAMI.2011.69
REFERENCES
[1] M.D. Abràmoff, W.L.M. Alward, E.C. Greenlee, L. Shuba, C.Y. Kim, J.H. Fingert, and Y.H. Kwon, "Automated Segmentation of the Optic Disc from Stereo Color Photographs Using Physiologically Plausible Features," Investigative Ophthalmology and Visual Science, vol. 48, pp. 1665-1673, 2007.
[2] D. Scharstein and R. Szeliski, "A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms," Int'l J. Computer Vision, vol. 47, nos. 1-3, pp. 7-42, 2002.
[3] D.G. Lowe, "Distinctive Image Features from Scale-Invariant Keypoints," Int'l J. Computer Vision vol. 60, no. 2, pp. 91-110, 2004.
[4] K. Mikolajczyk and C. Schmid, "A Performance Evaluation of Local Descriptors," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 27, no. 10, pp. 1615-1630, Oct. 2005.
[5] J.S. Lim, Two-Dimensional Signal and Image Processing. Prentice Hall, 1990.
[6] H. Hirschmuller and D. Scharstein, "Evaluation of Cost Functions for Stereo Matching," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 1-8, 2007.
[7] G.P. Penney, J. Weese, J.A. Little, P. Desmedt, D.L.G. Hill, and D.J. Hawkes, "A Comparison of Similarity Measures for Use in 2D-3D Medical Image Registration," IEEE Trans. Medical Imaging, vol. 17, no. 4, pp. 586-595, Aug. 1998.
[8] A. Klaus, M. Sormann, and K. Karner, "Segment-Based Stereo Matching Using Belief Propagation and a Self-Adapting Dissimilarity Measure," Proc. 18th Int'l Conf. Pattern Recognition, 2006.
[9] Q. Yang, L. Wang, R. Yang, H. Stewenius, and D. Nister, "Stereo Matching with Color-Weighted Correlation, Hierarchical Belief Propagation, and Occlusion Handling," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 31, no. 3, pp. 492-504, Mar. 2009.
[10] C.L. Zitnick and T. Kanade, "A Cooperative Algorithm for Stereo Matching and Occlusion Detection," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 22, no. 7, pp. 675-684, July 2000.
[11] L. Alvarez, R. Deriche, J. Sanchez, and J. Weickert, "Dense Disparity Map Estimation Respecting Image Discontinuities: A PDE and Scale-Space Based Approach," J. Visual Comm. and Image Representation, vol. 13, nos. 1/2, pp. 3-21, 2002.
[12] D. Marr, Vision. W.H. Freeman and Co., 2005.
[13] J. Kim and T. Sikora, "Gaussian Scale-Space Dense Disparity Estimation with Anisotropic Disparity-Field Diffusion," Proc. Fifth Int'l Conf. 3-D Digital Imaging and Modeling, pp. 556-563, 2005.
[14] M.Z. Brown, D. Burschka, and G.D. Hager, "Advances in Computational Stereo," IEEE Trans. Pattern Analysis and Machine Intelligence vol. 25, no. 8, pp. 993-1008, Aug. 2003.
[15] B. Zitova and J. Flusser, "Image Registration Methods: A Survey," Image and Vision Computing, vol. 21, no. 11, pp. 977-1000, 2003.
[16] M. Niemeijer, B. Van Ginneken, and M.D. Abràmoff, "Automated Localization of the Optic Disc and Fovea," Proc. IEEE 30th Ann. Int'l Conf. Eng. Medicine and Biology Soc., pp. 3538-3541, 2008.
[17] M. Haeker, M.D. Abràmoff, X. Wu, R. Kardon, and M. Sonka, "Use of Varying Constraints in Optimal 3D Graph Search for Segmentation of Macular Optical Coherence Tomography Images," Proc. Int'l Conf. Medical Image Computing and Computer Assisted Intervention, vol. 10 (Pt 1), pp. 244-51, 2007.
[18] M. Haeker, M.D. Abràmoff, R. Kardon, and M. Sonk, "Segmentation of the Surfaces of the Retinal Layer from OCT Images," Proc. Ninth Int'l Conf. Medical Image Computing and Computer Assisted Intervention, vol. 4190, pp. 800-807, 2006.
[19] K. Lee, M. Niemeijer, M.K. Garvin, Y.H. Kwon, M. Sonka, and M.D. Abràmoff, "3D Segmentation of the Rim and Cup in Spectral-Domain Optical Coherence Tomography Volumes of the Optic Nerve Head," Proc. SPIE, 2009.
[20] M.K. Garvin, M.D. Abràmoff, R. Kardon, S.R. Russell, X. Wu, and M. Sonka, "Intraretinal Layer Segmentation of Macular Optical Coherence Tomography Images Using Optimal 3D Graph Search," IEEE Trans. Medical Imaging vol. 27, no. 10, pp. 1495-1505, Oct. 2008.
[21] P.F. Felzenszwalb and D.P. Huttenlocher, "Efficient Belief Propagation for Early Vision," Int'l J. Computer Vision, vol. 70, no. 1, pp. 41-54, 2006.
[22] C.L. Zitnick and S.B. Kang, "Stereo for Image-Based Rendering Using Image over-Segmentation," Int'l J. Computer Vision, vol. 75, no. 1, pp. 49-65, 2007.
[23] B.M. ter Haar Romeny, Front-End Vision and Multi-Scale Image Analysis: Multi-Scale Computer Vision Theory and Applications, Written in Mathematica. Springer 2003.
[24] M. Maimone and S. Shafer, "Modeling Foreshortening in Stereo Vision Using Local Spatial Frequency," Proc. 1995 IEEE/RSJ Int'l Conf. Intelligent Robots and Systems, pp. 519-524, 1995.
[25] R. Szeliski, R. Zabih, D. Scharstein, O. Veksler, V. Kolmogorov, A. Agarwala, M. Tappen, and C. Rother, "A Comparative Study of Energy Minimization Methods for Markov Random Fields with Smoothness-Based Priors," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 30, no. 6, pp. 1068-1080, June 2008.
[26] Y. Boykov and V. Kolmogorov, "An Experimental Comparison of Min-Cut/Max-Flow Algorithms for Energy Minimization in Vision," IEEE Trans. Pattern Analysis and Machine Intelligence vol. 26, no. 9, pp. 1124-1137, Sept. 2004.
[27] L. Zhang and S.M. Seitz, "Estimating Optimal Parameters for MRF Stereo from a Single Image Pair," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 29, no. 2, pp. 331-342, Feb. 2007.
[28] J.-P. Pons, R. Keriven, and O. Faugeras, "Multi-View Stereo Reconstruction and Scene Flow Estimation with a Global Image-Based Matching Score," Int'l J. Computer Vision, vol. 72, no. 2, pp. 179-193, 2007.
[29] G. Van Meerbergen, M. Vergauwen, M. Pollefeys, and L. Van Gool, "A Hierarchical Symmetric Stereo Algorithm Using Dynamic Programming," Int'l J. Computer Vision, vol. 47, nos. 1-3, pp. 275-285, 2002.
[30] M. Okutomi, Y. Katayama, and S. Oka, "A Simple Stereo Algorithm to Recover Precise Object Boundaries and Smooth Surfaces," Int'l J. Computer Vision, vol. 47, nos. 1-3, pp. 261-273, 2002.
[31] S.T. Barnard and W.B. Thompson, "Disparity Analysis of Images," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 2, no. 4, pp. 333-340, July 1980.
[32] P. Favaro, S. Soatto, M. Burger, and S.J. Osher, "Shape from Defocus via Diffusion," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 30, no. 3, pp. 518-531, Mar. 2008.
[33] D. Marr and T. Poggio, "Cooperative Computation of Stereo Disparity," Science, vol. 194, pp. 209-236, 1976.
[34] J.S. Schuman et al., "Optical Coherence Tomography: A New Tool for Glaucoma Diagnosis," Current Opinion in Ophthalmology, vol. 6, no. 2, pp. 89-95, 1995.
[35] B. Platel, F.M.W. Kanters, L.M.J. Florack, and E.G. Balmachnova, "Using Multiscale Top Points in Image Matching," Proc. Int'l Conf. Image Processing, vol. 1, pp. 389-392, 2004.
[36] D. Scharstein and R. Szeliski, "High-Accuracy Stereo Depth Maps Using Structured Light," Proc. IEEE CS Conf. Computer Vision and Pattern Recognition, vol. 1, pp. 195-202, 2003.
[37] T. Brox, A. Bruhn, N. Papenberg, and J. Weickert, "High Accuracy Optical Flow Estimation Based on a Theory for Warping," Proc. European Conf. Computer Vision, 2004.
[38] H. Hirschmuller and D. Scharstein, "Evaluation of Stereo Matching Costs on Images with Radiometric Differences," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 31, no. 9, pp. 1582-1599, Sept. 2009.
[39] M.D. Menz and R.D. Freeman, "Stereoscopic Depth Processing in the Visual Cortex: A Coarse-to-Fine Mechanism," Nature Neuroscience, vol. 6, pp. 59-65, 2002.
[40] F. Laliberte, L. Gagnon, and Y. Shen, "Three-Dimensional Visualization of Human Fundus from a Sequence of Angiograms," Proc. SPIE , vol. 56, no. 64, pp. 412-420, 2005.
[41] T.E. Choe, G. Medioni, I. Cohen, A.C. Walsh, and S.R. Sadda, "2D Registration and 3D Shape Inference of the Retinal Fundus from Fluorescein Images," Medical Image Analysis, vol. 12, no. 2, pp. 174-190, 2008.
[42] H. Hirschmueller and S. Gehrig, "Stereo Matching in the Presence of Sub-Pixel Calibration Errors," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2009.
[43] J. Kim, V. Kolmogorov, and R. Zabih, "Visual Correspondence Using Energy Minimization and Mutual Information," Proc. Int'l Conf. Computer Vision, pp. 1033-1040, Oct. 2003.
[44] E. Tola, V. Lepetit, and P. Fua, "DAISY: An Efficient Dense Descriptor Applied to Wide Baseline Stereo," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 32, no. 5, pp. 815-830, May 2010.
[45] T. Brox, C. Bregler, and J. Malik, "Large Displacement Optical Flow," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2009.
[46] E. Tola, V. Lepetit, and P. Fua, "A Fast Local Descriptor for Dense Matching," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2008.
23 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool