This Article 
 Bibliographic References 
 Add to: 
Using Models to Improve Stereo Reconstruction
February 1992 (vol. 14 no. 2)
pp. 269-277

The authors propose the combination of photometric and stereometric information to solve the stereo vision problem in the case of a man-made environment. A method to introduce geometrical models in the stereo process in order to improve the accuracy of the depth measurement and to extend the depth map to points where no measurements have been made is presented. This method is based on a parameterization of the object surfaces and relies on a systematic comparison of the result of a stereo process with the photometric (or gray-level) image. The proposed approach improves the accuracy of the stereo information and its density by introducing a hypothesis on the object surfaces. Two kinds of hypothesis are developed: planar and quadratic objects. Reconstructions of complex scenes are given.

[1] H. H. Baker and T. O. Binford, "Depth from edges and intensity based stereo," inProc. 7th Int. Joint Conf. Artificial Intell. (Vancouver), 1981, pp. 631-636.
[2] P. Burt and B. Julesz, "A disparity gradient limit for binocular fusion,"Science, vol. 208, pp. 615-617, 1980.
[3] S. Castan, and J. Shen, "A stereo vision algorithm taking into account the perspective distortions," inProc. 7th ICPR, (Montreal), 1984, pp. 444-446.
[4] R. D. Eastman and A. M. Waxman, "Using disparity functionals for stereo correspondence and surface reconstruction,"Comput. Vision, Graphics, Image Processing, vol. 39, pp. 73-101, 1987.
[5] M. A. Fischler and R. C. Bolles, "Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography,"Commun. ACM, vol. 24, no. 6, pp. 381-395, 1981.
[6] W. Foerstner and A. Pertle, "Photogrammetric standard methods and digital images matching techniques for high precision surface measurements,"Patt. Recogn. Practice, pp. 57-72, 1986.
[7] W. E. L. Grimson,From Images fo Surfaces. Cambridge, MA: MIT Press, 1981.
[8] W. E. L. Grimson, "Computational experiments with a feature based stereo algorithm,"IEEE Trans. Patt. Anal. Machine Intell., vol. 7, pp. 17-34, 1985.
[9] W. E. L. Grimson and T. Pavlidis, "Discontinuity detection for visual surface reconstruction,"CVGIP, vol. 30, pp. 316-330, 1985.
[10] A. W. Gruen and E.P. Baltsavias, "High precision image matching for digital terrain model generation", inProc. ISPRS, Commission III(Finland), Aug. 19-22, 1986, pp. 284-296.
[11] W. Hoff and N. Ahuja, "Surfaces from stereo: Integrating feature matching, disparity estimation, and contour detection,"IEEE Trans Patt. Anal. Machine Intell., vol. 11, no. 2, pp. 121-136, 1989.
[12] Y. C. Hsieh, F. Perlant, and D. M. McKeown, "Recovering 3D information from complex aerial imagery, " inProc. 10th ICPR(Atlantic City), 1990, pp. 136-146.
[13] N. H. Kim and A. C. Bovik, "A contour-based stereo matching algorithm using disparity continuity,"Patt. Recogn., vol. 21, no. 5, pp. 505-514, 1988.
[14] W. Luo and H. Maître, "Using surface model to correct and fit disparity data in stereo vision," inProc. 10th ICPR(Atlantic City), 1990, pp. 60- 64.
[15] W. Luo and H. Maitre, "Quality assessment of a model oriented stereo method," inProc. SPIE Close-Range Photogrammetty Meets Machine Vision(Zurich), vol. 1395, 1990, pp. 518-525.
[16] D. Marr and T. Poggio, "Cooperative computation of stereo disparity,"Science, vol. 194, pp. 238-287, 1976.
[17] J. E. W. Mayhew and J. P. Frisby, "Psychophysical and computational studies towards a theory of human stereopsis,"Artificial Intell., vol. 17, pp. 349-385, 1981.
[18] R. Mohan, G. Medioni, and R. Nevatia, "Stereo error detection, correction, and evaluation,"IEEE Trans. Patt. Anal. Machine Intell., vol. 11, no. 2, pp. 113-120, 1989.
[19] S. B. Pollard, J. J. W. Mayhew, and J. P. Frisby, "PMF: A stereo correspondence algorithm using a disparity gradient limit,"Perception, vol. 14, pp. 449-470, 1985.
[20] M. Suk and S. M. Chung, "A new image segmentation technique based on partition mode test,"Patt. Recogn., vol. 16, no. 5, pp. 469-480, 1983.
[21] D. Terzopoulos, "Multilivel computational processes for visual surface reconstruction,"CVGIP, vol. 24, no. 1, pp. 52-96, 1983.
[22] D. Terzopoulos, "Regularization of inverse visual problems involving discontinuities,"IEEE Trans. Pattern Anal. Machine Intell., vol. PAMI-8, no. 4, pp. 413-424, July 1986.
[23] B. P. Wrobel, "Least squares methods for surface reconstruction from images," inProc. ISPRS Commission III(Kyoto), 1988, pp. 806-821.
[24] Y. F. Wu and H. Maître, "Mise en correspondance d'images Stéréo par programmation dynamique utilisant la cohérence inter lignes," inProc. 12th GRETSI(Juan-les-Pins, France), June 12-16, 1989.

Index Terms:
stereo vision reconstruction; photometric information; pattern recognition; object surface parameterisation; computer vision; planar objects; stereometric information; geometrical models; quadratic objects; computational geometry; computer vision; pattern recognition; picture processing
H. Maître, W. Luo, "Using Models to Improve Stereo Reconstruction," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 14, no. 2, pp. 269-277, Feb. 1992, doi:10.1109/34.121794
Usage of this product signifies your acceptance of the Terms of Use.