This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Direct Recovery of Three-Dimensional Scene Geometry From Binocular Stereo Disparity
August 1991 (vol. 13 no. 8)
pp. 761-774

An analysis of disparity is presented. It makes explicit the geometric relations between a stereo disparity field and a differentially project scene. These results show how it is possible to recover three-dimensional surface geometry through first-order (i.e., distance and orientation of a surface relative to an observer) and binocular viewing parameters in a direct fashion from stereo disparity. As applications of the analysis, algorithms have been developed for recovering three-dimensional surface orientation and discontinuities from stereo disparity. The results of applying these algorithms to natural image binocular stereo disparity information are presented.

[1] P. Anandan, "A unified perspective on computational techniques for the measurement of visual motion" inProc. Int. Conf. Computer Vision, 1987, pp. 462-472.
[2] S. T. Barnard and M. A. Fischler, "Computational stereo,"Comput. Surveys, vol. 14, no. 4, pp. 553-572, 1982.
[3] A. Blake and A. Zisserman,Visual Reconstruction. Cambridge, MA: MIT Press, 1987.
[4] T. E. Boult, "Reproducing kernels for surface interpolation," Columbia Univ., New York, NY, A.I. Memo, 1987.
[5] J. M. Brady, J. Ponce, A. Yuille, and H. Asada, "Describing surfaces," Massachusetts Inst. Technol., Cambridge, A.I. Memo 822, 1985.
[6] J. F. Canny, "A computational approach to edge detection,"IEEE Trans. Pattern Anal. Machine Intell., vol. PAMI-8, pp. 679-697, 1986.
[7] W. F. Clocksin, "Perception of surface slant and edge labels from optical flow,"Perception, vol. 9, pp. 253-269, 1980.
[8] G. Dahlquist andÅ. Björk,Numerical Methods. Englewood Cliffs, NJ: Prentice-Hall, 1974.
[9] R. D. Eastman and A. M. Waxman, "Using disparity functionals for stereo correspondence and surface reconstruction,"Comput. Vision, Graphics, Image Processing, vol. 39, pp. 73-101, 1987.
[10] W. E. L. Grimson,From Images to Surfaces. Cambridge, MA: MIT Press, 1981.
[11] W. E. L. Grimson and T. Pavlidis, "Discontinuity detection for visual surface reconstruction,"Comput. Vision, Graphics, Image Processing, vol. 30, pp. 316-330, 1985.
[12] J. G. Harris, "The coupled depth slope approach to surface reconstruction," inProc. Int. Conf. Computer Vision, 1987, pp. 277-283.
[13] W. Hoff and N. Ahuja, "Extracting surfaces from stereo images," inProc. Int. Conf. Computer Vision, 1987, pp. 284-294.
[14] B. K. P. Horn, "Relative orientation,"Int. J. Computer Vision, vol. 4, no. 1, pp. 59-78, 1990.
[15] K. Kanatani, "Structure from motion without correspondence: General principle," inProc. Int. Joint Conf. Artificial Intelligence, 1985, pp. 886-888.
[16] C. Koch, J. Marroquin, and A. Yuille, "Analog 'Neural' Networks in Early Vision," Massachusetts Inst. Technol., Cambridge, A.I. Memo 751, 1985.
[17] J. J. Koenderink and A. J. van Doorn, "Geometry of binocular vision and a model for stereopsis,"Biol. Cybern., vol. 21, pp. 29-35, 1976.
[18] J. J. Koenderink and A. J. van Doorn, "Local structure of movement parallax of the plane,"J. Opt. Soc. Amer., vol. 66, no. 7, pp. 717-723, 1976.
[19] G. A. Korn and T. M. Korn,Mathematical Handbook for Scientists and Engineers, New York: McGraw-Hill, 1961.
[20] D. Lee and T. Pavlidis, "One-dimensional regularization with discontinuities," inProc. Int. Conf. Computer Vision, 1987, pp. 572-577.
[21] H. C. Longuet-Higgins and K. Pradzny, "The interpretation of a moving retinal image,"Proc. Roy. Soc. London B, vol. 208, pp. 385-397, 1980.
[22] Manual of Photogrammetry. Washington, DC: Amer. Soc. Photogrammetry (no author or editor named), 1966.
[23] J. L. Marroquin, "Surface reconstruction preserving discontinuities," Massachusetts Inst. Technol., Cambridge, A.I. Memo 792, 1984.
[24] J. E. W. Mayhew and H. C. Longuet-Higgins, "A computational model of binocular depth perception,"Nature, vol. 297, pp. 376-378, 1982.
[25] G. Medioni and R. Nevatia, "Description of three-dimensional surfaces using curvature properties," inProc. DARPA Image Understanding Workshop, 1984, pp. 219-229.
[26] K. M. Mutch and W. B. Thompson, "Analysis of accretion and deletion at boundaries in dynamic scenes,"IEEE Trans. Pattern Anal. Machine Intell., vol. 7, no. 2, pp. 133-138, 1985.
[27] K. Pradzny, "Egomotion and relative depth map from optical flow,"Biol. Cybern.vol. 36, pp. 87-102, 1980.
[28] B. Schunk, "The motion constraint equation for optical flow," inProc. Int. Joint Conf. Pattern Recognition, 1986, pp. 20-22.
[29] S. Siegel,Nonparametric statistics. New York: McGraw-Hill, 1956.
[30] T. Smitley and R. Bajcsy, "Stereo processing of aeriel urban images," inProc. Int. Joint Conf. Pattern Recognition, 1984, pp. 405-409.
[31] K. A. Stevens and A. Brookes, "Depth reconstruction in stereopsis," inProc. Int. Conf. Computer Vision, 1987, pp. 549-603.
[32] M. Subbarao, "Interpretation of image flow,"Int. J. Comput. Vision, vol. 2, no. 1, pp. 77-96, 1988.
[33] D. Terzopoulos, "Regularization of inverse visual problems involving discontinuities,"IEEE Trans. Pattern Anal. Machine Intell., vol. PAMI-8, no. 4, pp. 413-424, July 1986.
[34] D. Terzopoulos, "Integrating visual information from multiple sources," inFrom Pixels to Predicates, S. Pentland, Ed. Norwood, NJ: Ablex, 1986.
[35] W. B. Thompson, K. M. Mutch, and V. A. Berzins, "Edge detection in optical flow fields," inProc. Amer. Assoc. Artificial Intelligence, 1985, pp. 26-29.
[36] W. B. Thompson, K. M. Mutch, and V. A. Berzins, "Dynamic occlusion analysis in optical flow fields,"IEEE Trans. Pattern Anal. Machine Intell., vol. PAMI-7, no. 4, pp. 374-383, 1985.
[37] C. Truesdell and R. A. Toupin, "The classical field theories," inHandbuch der Physik, S. Flügge, Ed. Berlin: Springer-Verlag, 1960.
[38] A. Waxman and S. Ullman, "Surface structure and three-dimensional motion from image flow kinematics,"Int. J. Robotics Res., vol. 4, no. 3, pp. 72-94, 1985.
[39] D. Weinshall, "Qualitative depth and shape from stereo in agreement with psychophysical evidence,"Massachusetts Inst. Technol., Cambridge, A.I. Memo 1007, 1987.
[40] R. P. Wildes, "On interpreting stereo disparity," Massachusetts Inst. Technol., Cambridge, A.I. Lab. Tech. Rep. 1112, 1989.
[41] Y. Yeshurun and E. L. Schwartz, "Cepstral filtering on a columnar image architecture: A fast algorithm for binocular stereo segmentation,"IEEE Trans. Pattern Anal. Machine Intell., vol. 11, no. 7, pp. 759-767, 1989.

Index Terms:
picture processing; pattern recognition; three-dimensional scene geometry; binocular stereo disparity; stereo disparity field; surface geometry; natural image; geometry; pattern recognition; picture processing
Citation:
R.P. Wildes, "Direct Recovery of Three-Dimensional Scene Geometry From Binocular Stereo Disparity," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 13, no. 8, pp. 761-774, Aug. 1991, doi:10.1109/34.85667
Usage of this product signifies your acceptance of the Terms of Use.