This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Intensity- and Gradient-Based Stereo Matching Using Hierarchical Gaussian Basis Functions
November 1998 (vol. 20 no. 11)
pp. 1143-1160

Abstract—In this paper, we propose a stereo correspondence method by minimizing intensity and gradient errors simultaneously. In contrast to conventional use of image gradients, the gradients are applied in the deformed image space. Although a uniform smoothness constraint is imposed, it is applied only to nonfeature regions. To avoid local minima in the function minimization, we propose to parameterize the disparity function by hierarchical Gaussians. Both the uniqueness and the ordering constraints can be easily imposed in our minimization framework. Besides, we propose a method to estimate the disparity map and the camera response difference parameters simultaneously. Experiments with various real stereo images show robust performances of our algorithm.

[1] N. Ayache and B. Faverjon, "Efficient Registration of Stereo Images by Matching Graph Description of Edge Segments," Int'l J. Computer Vision, pp. 107-131, 1987.
[2] N. Ayache and C. Hansen, "Rectification of Images for Binocular and Triocular Stereovision," Proc. Int'l Conf. Pattern Recognition, pp. 11-16, 1988.
[3] P. Aschwanden, W. Guggenbuehl, "Experimental Results From a Comparative Study on Correlation-Type Registration Algorithms," Robust Computer Vision, Foerstner and Ruwiedel, eds., pp. 268-289. Wichmann, 1993.
[4] S.T. Banard and W.B. Thompson, "Disparity Analysis of Images," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 2, no. 4, pp. 333-340, July 1980.
[5] S.T. Banard, "Stochastic Stereo Matching Over Scale," Int'l J. Computer Vision, vol. 3, pp. 17-32, 1989.
[6] P.N. Belhumeur, "A Bayesian Approach to Binocular Stereopsis," Int'l J. Computer Vision, vol. 19, no. 3, 1996, pp. 237-260.
[7] R.C. Bolles, H.H. Baker, M.J. Hannah, "The JISCT Stereo Evaluation," Proc. DARPA Image Understanding Workshop, pp. 263-274, 1993.
[8] K.L. Boyer and A.C. Kak,“Structural stereopsis in 3D vision,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 10, no. 2, pp. 144-166, 1988.
[9] Y. Boykov, O. Veksler, R. Zabih, "Disparity Component Matching for Visual Correspondence," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 1997.
[10] D.J. Burr, "A Dynamic Model for Image Registration," Computer Vision, Graphics, and Image Processing, vol. 15, pp. 102-112, 1981.
[11] S.D. Cochran and G. Medioni, "3-D Surface Description From Binocular Stereo," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 14, no. 10, pp. 981-994, Oct. 1992.
[12] I.J. Cox, S.L. Hingorani, S.B. Rao, and B.M. Maggs, "A Maximum Likelihood Stereo Algorithm," Computer Vision and Image Understanding, vol. 63, no. 3, pp. 542-567, 1996.
[13] M.A. Gennert, "Brightness-Based Stereo Matching," Proc. Int'l Conf. Computer Vision, pp. 139-143, 1988.
[14] W.E.L. Grimson, "Computational Experiments With a Feature Basded Stereo Algorithm," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 7, no. 1, pp. 17-34, Jan. 1985.
[15] A. Goshtasby, W.D. O'Neill, "Curve Fitting by a Sum of Gaussians," CVGIP: Graphical Models and Image Processing, vol. 56, no. 4, pp. 281-288, 1994.
[16] W. Hoff and N. Ahuja, "Surfaces From Stereo: Integrating Feature Matching, Disparity Estimation, and Contour Detection," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 11, no. 2, pp. 121-136, Feb. 1989.
[17] B.K.P. Horn, Robot Vision.Cambridge Mass.: MIT Press, 1986.
[18] M.D. Levine, D.A. O'Handley, and G.M. Yagi, "Computer Determination of Depth Maps," Computer Graphics and Image Processing, vol. 2, pp. 131-150, 1973.
[19] T. Kanade and M. Okutomi, “A Stereo Matching Algorithm with an Adaptive Window: Theory and Experiment,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 16, pp. 920-932, 1994.
[20] A. Luo and H. Burkhardt, "An Intensity-Based Cooperative Bidirectional Stereo Matching With Simultaneous Detection of Discontinuities and Occlusions," Int'l J. Computer Vision, vol. 15, pp. 171-188, 1995.
[21] S.B. Marapane and M.M. Trivedi, "Multi-Primitive Hierachical (MPH) Stereo Analysis," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 16, no. 3, pp. 227-240, 1994.
[22] J.E.W. Mayhew and J.P. Fisby, "Psychophysical and Computational Studies Toward Depth Perception," Artificial Intelligence, vol. 17, pp. 349-385, 1981.
[23] G. Medioni and R. Netatia, "Segment-Based Stereo Matching," Computer Vision, Graphics, and Image Processing, vol. 31 pp. 2-18, 1985.
[24] Y. Ohta and T. Kanade, "Stereo by Intra- and Inter-Scanline Search Using Dynamic Programming," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 7, no. 2, pp. 139-154, Mar. 1985.
[25] J. Park and I.W. Sandberg, "Universal Approximation Using Radial-Basis-Function Networks," Neural Computation, vol. 3, pp. 246-257, 1991.
[26] T. Poggio, V. Torre, and C. Koch, "Computational Vision and Regularization Theory," Nature, vol. 317, pp. 314-319, 1985.
[27] T. Poggio and F. Girosi, Networks for Approximation and Learning Proc. IEEE, vol. 78, pp. 1481-1497, 1990.
[28] W.H. Press et al., Numerical Recipes in C: The Art of Scientific Computing, 2nd ed. Cambridge Univ. Press, 1992
[29] S. Roy and I.J. Cox, "A Maximum-Flow Formulation of the N-Camera Stereo Correspondence Problem," Proc. Int'l Conf. Computer Vision, pp. 492-499,Bombay, Jan. 1998.
[30] D.E. Rumelhart, G.E. Hinton, and R.J. Williams, "Learning Internal Representation by Error Propagation," D.E. Rumelhart, and J.L. McClelland, eds., Parallel Distributed Processing: Explorations in the Microstructure of Cognition, vol. I, pp. 318-362.Cambridge Mass.: MIT Press, 1986
[31] D. Scharstein, "Matching Images by Comparing Their Gradient Fields," Proc. Int'l Conf. Pattern Recognition, pp. 572-575, 1994.
[32] S.M. Seitz and C.R. Dyer, “Photorealistic Scene Reconstruction by Voxel Coloring,” Computer Vision and Pattern Recognition, pp. 1067-1073, 1997.
[33] R. Szeliski, "Fast Shape From Shading," Computer Vision, Graphics and Image Processing: Image Understanding, vol. 53, no. 2, pp. 125-153, 1991.
[34] R. Szeliski and H.-Y. Shum, "Motion Estimation With Quadtree Splines," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 18, no. 12, pp. 1,199-1,210, 1996
[35] R. Szeliski and P. Golland, “Stereo Matching with Transparency and Matting,” Proc. Sixth Int'l Conf. Computer Vision (ICCV '98), pp. 517-524, 1998.
[36] D. Terzopoulos, "Image Analysis Using Multigrid Relaxation Methods," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 8, no. 2, pp. 129-139, Mar. 1986.
[37] J. Weng,N. Ahuja,, and T. S. Huang,“Matching two perspective views,” Trans. Pattern Analysis and Machine Intelligence Intell., vol. 14, no. 8, pp. 806-825, 1992.
[38] A. Witkin, D. Terzopoulos, and M. Kass, "Signal Matching Through Scale Space," Int'l J. Computer Vision, pp. 133-144, 1987.
[39] Y. Yang and A.L. Yuille, "Multilevel Enhancement and Detection of Stereo Disparity Surfaces," Artificial Intelligence, vol. 78, pp. 121-145, 1995.
[40] A.L. Yuille, D. Geiger, H. Hülthoff, "Stereo Integration, Mean Field Theory and Psychophysics," Proc. European Conf. Computer Vision, pp. 73-82, 1990.
[41] Z. Zhang, R. Deriche, O. Faugeras, and Q.-T. Luong, "A Robust Technique for Matching Two Uncalibrated Images Through the Recovery of the Unknown Epipolar Geometry," Artificial Intelligence, vol. 78, 1995.
[42] G.-Q. Wei and S.D. Ma, "Implicit and Explicit Camera Calibration: Theorey and Experiments," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 16, no. 5, pp. 469-480, May 1994
[43] G.Q. Wei and G. Hirzinger, "Parametric Shape-From-Shading by Radial Basis Functions," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 19, no. 4, pp. 353-365, Apr. 1997
[44] Y. Weiss, "Smoothness in Layers: Motion Segmentation Using Nonparametric Mixture Estimation," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 520-527, 1997.

Index Terms:
Stereo matching, intensity values, intensity gradients, deformation, scale-space, hierarchical Gaussians, ordering constraint, stochastic gradients, response difference compensation.
Citation:
Guo-Qing Wei, Wilfried Brauer, Gerd Hirzinger, "Intensity- and Gradient-Based Stereo Matching Using Hierarchical Gaussian Basis Functions," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 20, no. 11, pp. 1143-1160, Nov. 1998, doi:10.1109/34.730551
Usage of this product signifies your acceptance of the Terms of Use.