| | This Article | |
| |
| |
| | Share | |
| |
| |
| | Bibliographic References | |
| |
| |
| | Add to: | |
| |
 Digg
 Furl
 Spurl
 Blink
 Simpy
 Google
 Del.icio.us
 Y!MyWeb
| |
| | Search | |
| |
| |
| | |
Surfaces from Stereo: Integrating Feature Matching, Disparity Estimation, and Contour Detection
February 1989 (vol. 11 no. 2)
pp. 121-136
An approach is described that integrates the processes of feature matching, contour detection, and surface interpolation to determine the three-dimensional distance, or depth, of objects from a stereo pair of images. Integration is necessary to ensure that the detected surfaces are smooth. Surface interpolation takes into account detected occluding and ridge contours in the scene; interpolation is performed within regions enclosed by these contours. Planar and quadratic patches are used as local models of the surface. Occluded regions in the image are identified, and are not used for matching and interpolation. A coarse-to-fine algorithm is presented that generates a multiresolution hierarchy of surface maps, one at each level of resolution. Experimental results are given for a variety of stereo images.
[1] 121W. Richards, "Stereopsis with and without monocular contours,"Vision Res., vol. 17, pp. 967-969, 1977.[2] B. Julesz,Foundations of Cyclopean Perception. Chicago, IL: University of Chicago Press, 1971.[3] D. Marr and T. Poggio, "A theory of human stereo vision,"Proc. Roy. Soc. London, vol. B 204, pp. 301-328, 1979.[4] D. Marr,Vision. San Francisco, CA: Freeman, 1982.[5] W. E. L. Grimson,From Images to Surfaces. Cambridge, MA: MIT Press, 1981.[6] S. T. Barnard and M. A. Fischler, "Computational stereo,"Comput. Surveys, vol. 14, no. 4, pp. 553-572, 1982.[7] A. Rosenfeld, R. Hummel, and S. Zucker, "Scene labeling by relaxation operations,"IEEE Trans. Syst., Man, Cybern., vol. SMC-6. pp. 420-433.[8] G. Medioni and R. Nevatia, "Segment-based stereo matching."Comput. Vision, Graphics, Image Processing, vol. 31, pp. 2-18, July 1985.[9] N. Ayache and B. Faverjon, "Fast stereo matching of edge segments using prediction and verification of hypotheses," inProc. Computer Vision and Pattern Recognition, June 1985, pp. 662-664.[10] J. E. W. Mayhew and J. P. Frisby, "Psychophysical and computational studies towards a theory of human stereopsis,"Artificial Intell., vol. 17, pp. 349-385, Aug. 1981.[11] W. E. L. Grimson, "Computational experiments with a feature based stereo algorithm,"IEEE Trans. Pattern Anal. Machine Intell., vol. PAMI-7, pp. 17-34, Jan. 1985.[12] H. H. Baker and T. O. Binford, "Depth from edges and intensity based stereo," inProc. Int. Joint Conf. Artificial Intell., Aug. 1981, pp. 631-636.[13] Y. Ohta and T. Kanade, "Stereo by intra- and inter-scanline search using dynamic programming,"IEEE Trans. Pattern Anal. Machine Intell., vol. PAMI-7, pp. 139-154, Mar 1985.[14] W. Hoff and N. Ahuja, "Extracting surfaces from stereo: An integrated approach," Univ. Illinois Coordinated Sci. Lab., Tech. Rep. ILU ENG-87-2204, Jan. 1987 (a part of this report appears inProc. 1st Int. Conf. Computer Vision, London. June 1987, pp. 284-294).[15] W. Hoff and N. Ahuja, "Depth from stereo," inProc. Fourth Scandinavian Conf. Image Analysis, Trondheim, Norway, June 18-20, 1985, pp. 761-768.[16] W. Hoff and N. Ahuja, "Surfaces from stereo," inProc. DARPA Image Understanding Workshop, Miami Beach, FL, Dec. 1985, pp. 98-106.[17] S. Olsen, "Concurrent solution of the stereo correspondence problem and the surface reconstruction problem," inProc. Eigth Int. Conf. Pattern Recognition, 1986, pp. 1038-1041.[18] H. P. Moravec, "Towards automatic visual obstacle avoidance," inProc. Fifth Int. Joint Conf. Artificial Intelligence, Cambridge, MA, 1977, p. 584.[19] D. Marr and E. Hildreth, "Theory of edge detection,"Proc. Roy. Soc. London, vol. B 207, pp. 187-217, 1980.[20] R. D. Eastman and A. M. Waxman, "Using disparity functionals for stereo correspondence and surface reconstruction,"Comput. Vision, Graphics, Image Processing, vol. 39, pp. 73-101, 1987.[21] R. O. Duda and P. E. Hart,Pattern Classification and Scene Analysis. New York: Wiley, 1973.[22] J. Clark and P. Lawrence, "A theoretical basis for diffrequency stereo,"Comput. Vision, Graphics, Image Processing, vol. 35, pp. 1- 19, 1986.[23] J.D. Foley and A. Van Dam,Fundamentals of Interactive Computer Graphics(The System Programming Series). Reading, MA: Addison-Wesley, 1982.[24] P. Brodatz,Textures: A Photographic Album for Artists and Designers. New York: Dover, 1956.[25] J. E. W. Mayhew and J. P. Frisby, "The computation of binocular edges,"Perception, vol. 9, pp. 69-96, 1980.[26] B. Gilliam, T. Flagg, and D. Finlay, "Evidence for disparity change as the primary stimulus for stereoscopic processing,"Perception Psychophys., vol. 36, no. 6, pp. 559-564, 1984.[27] M. Brady, "Artificial intelligence approaches to image understanding," inPattern Recognition Theory and Applications: Proc. NATO Advanced Study Institute, Mar. 29-Apr. 10, 1981, J. Kittler, K. S. Fu, and L. F. Pau, Eds. Dordrecht, The Netherlands: Reidel, 1982.[28] Y. Leclerc and S. W. Zucker, "The local structure of image discontinuities in one dimension," inProc. 7th Int. Conf. Pattern Recognition, July 1984, pp. 46-48.[29] K. L. Boyer and A. C. Kak, "Structural stereopsis for 3-D vision,"IEEE Trans. Pattern Anal. Machine Intell., vol. 10, pp. 144-166, Mar. 1988.[30] T. E. Boult and L. H. Chen, "Analysis of two new stereo algorithms," inProc. IEEE Conf. Computer Vision and Pattern Recognition, Ann Arbor, MI, June 1988, pp. 177-182.
Index Terms:
stereo images; 3D surface recovery; feature matching; disparity estimation; contour detection; surface interpolation; coarse-to-fine algorithm; surface maps; computerised pattern recognition; computerised picture processing
Citation:
W. Hoff, N. Ahuja, "Surfaces from Stereo: Integrating Feature Matching, Disparity Estimation, and Contour Detection," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 11, no. 2, pp. 121-136, Feb. 1989, doi:10.1109/34.16709
