loading...
 This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Direct Recovery of Three-Dimensional Scene Geometry From Binocular Stereo Disparity
August 1991 (vol. 13 no. 8)
pp. 761-774

An analysis of disparity is presented. It makes explicit the geometric relations between a stereo disparity field and a differentially project scene. These results show how it is possible to recover three-dimensional surface geometry through first-order (i.e., distance and orientation of a surface relative to an observer) and binocular viewing parameters in a direct fashion from stereo disparity. As applications of the analysis, algorithms have been developed for recovering three-dimensional surface orientation and discontinuities from stereo disparity. The results of applying these algorithms to natural image binocular stereo disparity information are presented.

[1] P. Anandan, "A unified perspective on computational techniques for the measurement of visual motion" inProc. Int. Conf. Computer Vision, 1987, pp. 462-472.[2] S. T. Barnard and M. A. Fischler, "Computational stereo,"Comput. Surveys, vol. 14, no. 4, pp. 553-572, 1982.[3] A. Blake and A. Zisserman,Visual Reconstruction. Cambridge, MA: MIT Press, 1987.[4] T. E. Boult, "Reproducing kernels for surface interpolation," Columbia Univ., New York, NY, A.I. Memo, 1987.[5] J. M. Brady, J. Ponce, A. Yuille, and H. Asada, "Describing surfaces," Massachusetts Inst. Technol., Cambridge, A.I. Memo 822, 1985.[6] J. F. Canny, "A computational approach to edge detection,"IEEE Trans. Pattern Anal. Machine Intell., vol. PAMI-8, pp. 679-697, 1986.[7] W. F. Clocksin, "Perception of surface slant and edge labels from optical flow,"Perception, vol. 9, pp. 253-269, 1980.[8] G. Dahlquist andÅ. Björk,Numerical Methods. Englewood Cliffs, NJ: Prentice-Hall, 1974.[9] R. D. Eastman and A. M. Waxman, "Using disparity functionals for stereo correspondence and surface reconstruction,"Comput. Vision, Graphics, Image Processing, vol. 39, pp. 73-101, 1987.[10] W. E. L. Grimson,From Images to Surfaces. Cambridge, MA: MIT Press, 1981.[11] W. E. L. Grimson and T. Pavlidis, "Discontinuity detection for visual surface reconstruction,"Comput. Vision, Graphics, Image Processing, vol. 30, pp. 316-330, 1985.[12] J. G. Harris, "The coupled depth slope approach to surface reconstruction," inProc. Int. Conf. Computer Vision, 1987, pp. 277-283.[13] W. Hoff and N. Ahuja, "Extracting surfaces from stereo images," inProc. Int. Conf. Computer Vision, 1987, pp. 284-294.[14] B. K. P. Horn, "Relative orientation,"Int. J. Computer Vision, vol. 4, no. 1, pp. 59-78, 1990.[15] K. Kanatani, "Structure from motion without correspondence: General principle," inProc. Int. Joint Conf. Artificial Intelligence, 1985, pp. 886-888.[16] C. Koch, J. Marroquin, and A. Yuille, "Analog 'Neural' Networks in Early Vision," Massachusetts Inst. Technol., Cambridge, A.I. Memo 751, 1985.[17] J. J. Koenderink and A. J. van Doorn, "Geometry of binocular vision and a model for stereopsis,"Biol. Cybern., vol. 21, pp. 29-35, 1976.[18] J. J. Koenderink and A. J. van Doorn, "Local structure of movement parallax of the plane,"J. Opt. Soc. Amer., vol. 66, no. 7, pp. 717-723, 1976.[19] G. A. Korn and T. M. Korn,Mathematical Handbook for Scientists and Engineers, New York: McGraw-Hill, 1961.[20] D. Lee and T. Pavlidis, "One-dimensional regularization with discontinuities," inProc. Int. Conf. Computer Vision, 1987, pp. 572-577.[21] H. C. Longuet-Higgins and K. Pradzny, "The interpretation of a moving retinal image,"Proc. Roy. Soc. London B, vol. 208, pp. 385-397, 1980.[22] Manual of Photogrammetry. Washington, DC: Amer. Soc. Photogrammetry (no author or editor named), 1966.[23] J. L. Marroquin, "Surface reconstruction preserving discontinuities," Massachusetts Inst. Technol., Cambridge, A.I. Memo 792, 1984.[24] J. E. W. Mayhew and H. C. Longuet-Higgins, "A computational model of binocular depth perception,"Nature, vol. 297, pp. 376-378, 1982.[25] G. Medioni and R. Nevatia, "Description of three-dimensional surfaces using curvature properties," inProc. DARPA Image Understanding Workshop, 1984, pp. 219-229.[26] K. M. Mutch and W. B. Thompson, "Analysis of accretion and deletion at boundaries in dynamic scenes,"IEEE Trans. Pattern Anal. Machine Intell., vol. 7, no. 2, pp. 133-138, 1985.[27] K. Pradzny, "Egomotion and relative depth map from optical flow,"Biol. Cybern.vol. 36, pp. 87-102, 1980.[28] B. Schunk, "The motion constraint equation for optical flow," inProc. Int. Joint Conf. Pattern Recognition, 1986, pp. 20-22.[29] S. Siegel,Nonparametric statistics. New York: McGraw-Hill, 1956.[30] T. Smitley and R. Bajcsy, "Stereo processing of aeriel urban images," inProc. Int. Joint Conf. Pattern Recognition, 1984, pp. 405-409.[31] K. A. Stevens and A. Brookes, "Depth reconstruction in stereopsis," inProc. Int. Conf. Computer Vision, 1987, pp. 549-603.[32] M. Subbarao, "Interpretation of image flow,"Int. J. Comput. Vision, vol. 2, no. 1, pp. 77-96, 1988.[33] D. Terzopoulos, "Regularization of inverse visual problems involving discontinuities,"IEEE Trans. Pattern Anal. Machine Intell., vol. PAMI-8, no. 4, pp. 413-424, July 1986.[34] D. Terzopoulos, "Integrating visual information from multiple sources," inFrom Pixels to Predicates, S. Pentland, Ed. Norwood, NJ: Ablex, 1986.[35] W. B. Thompson, K. M. Mutch, and V. A. Berzins, "Edge detection in optical flow fields," inProc. Amer. Assoc. Artificial Intelligence, 1985, pp. 26-29.[36] W. B. Thompson, K. M. Mutch, and V. A. Berzins, "Dynamic occlusion analysis in optical flow fields,"IEEE Trans. Pattern Anal. Machine Intell., vol. PAMI-7, no. 4, pp. 374-383, 1985.[37] C. Truesdell and R. A. Toupin, "The classical field theories," inHandbuch der Physik, S. Flügge, Ed. Berlin: Springer-Verlag, 1960.[38] A. Waxman and S. Ullman, "Surface structure and three-dimensional motion from image flow kinematics,"Int. J. Robotics Res., vol. 4, no. 3, pp. 72-94, 1985.[39] D. Weinshall, "Qualitative depth and shape from stereo in agreement with psychophysical evidence,"Massachusetts Inst. Technol., Cambridge, A.I. Memo 1007, 1987.[40] R. P. Wildes, "On interpreting stereo disparity," Massachusetts Inst. Technol., Cambridge, A.I. Lab. Tech. Rep. 1112, 1989.[41] Y. Yeshurun and E. L. Schwartz, "Cepstral filtering on a columnar image architecture: A fast algorithm for binocular stereo segmentation,"IEEE Trans. Pattern Anal. Machine Intell., vol. 11, no. 7, pp. 759-767, 1989.

Index Terms:
picture processing; pattern recognition; three-dimensional scene geometry; binocular stereo disparity; stereo disparity field; surface geometry; natural image; geometry; pattern recognition; picture processing
Citation:
R.P. Wildes, "Direct Recovery of Three-Dimensional Scene Geometry From Binocular Stereo Disparity," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 13, no. 8, pp. 761-774, Aug. 1991, doi:10.1109/34.85667
Usage of this product signifies your acceptance of the Terms of Use.