This Article 
 Bibliographic References 
 Add to: 
Performance Evaluation of Scene Registration and Stereo Matching for Artographic Feature Extraction
February 1992 (vol. 14 no. 2)
pp. 214-238

Three major areas in the development of competent 3-D scene interpretation system are discussed. First, the importance of accurate automatic scene registration and the difficulty in automated extraction and matching of scene reference points are described. Second, the authors describe two stereo matching algorithms, S1, which is an area-based matcher previously used in the SPAM system, and S2, which is a feature-based matching algorithm based on hierarchical waveform matching. Third, the authors introduce several performance evaluation metrics that made it possible to measure the quality of the overall scene recovery, the building disparity estimate, and the quality and sharpness of the building delineations. Such manually generated scene reference models are critical for understanding strengths and weaknesses of various matching algorithms and in the incremental development of improvements to existing algorithms. Experiments were performed on difficult examples of aerial imagery.

[1] D. M. McKeown, "Toward automatic cartographic feature extraction," inMapping and Spatial Modeling for Navigation(L. F. Pau, Ed.). Berlin: Springer-Verlag, 1990, pp. 149-180, vol. F 65 (NATO ASI Series).
[2] S. T. Barnard and M. A. Fischler, "Computational stereo,"Comput. Surveys, vol. 14, no. 4, pp. 553-572, 1982.
[3] U. R. Dhond and J. K. Aggarwal, "Structure from stereo--A review,"IEEE Trans. Syst. Man Cybern., vol. 19, no. 6, pp. 1489-1510, Nov. 1989.
[4] The Manual of Photogrammetry. Falls Church, VA: Amer. Soc. Photogrammetry, 1980, 4th ed.
[5] M. Chevrel, M. Courtis, and G. Weill, "The SPOT satellite remote sensing mission,Photogrammetric Eng. Remote Sens., vol. 47, no. 8, pp. 1163-1171, Aug. 1981.
[6] D. J. Gugan and I. J. Dowman, "Topographic mapping from SPOT imagery."Photogrammetric Eng. Remote Sens., vol. 54, no. 10, pp. 1409-1414, Oct. 1988.
[7] A. P. Colvocoresses, "An operational earth mapping and monitoring satellite system: A proposal for Landsat 7,"Photogrammetric Eng. Remote Sens., vol. 56, no. 5, pp. 569-571, May 1990.
[8] M. A. Fischler, "An overview of computer vision research at SRI International-Themes and progress,"Int. J. Comput. Vision, vol. 3, no. 1, 1989.
[9] M. J. Hannah, "A system for digital stereo image matching,"Photogrammetric Eng. Remote Sens., vol. 55, no. 12, pp. 1765-1770, Dec. 1989.
[10] S. T. Barnard, "Recent progress in CYCLOPS: A system for stereo cartography," inProc. DARPA Image Understanding Workshop(Pittsburgh, PA), Sept. 1990, pp. 449-455.
[11] S. D. Cochran and G. Medioni, "Accurate surface description from binocular stereo," inProc. Workshop Interpretation 3-D Scenes(Austin, TX), Nov. 1989, pp. 16-23.
[12] G. Medioni and R. Nevatia, "Segment-based stereo matching,Comput. Graphics Image Processing, vol. 31, no. 1, pp. 2-18, July 1985.
[13] R. Mohan and R. Nevatia, "Using perceptual organization to extract 3-D structures,"IEEE Trans. Patt. Anal. Machine Intell., vol. 11, no. 11, pp. 1121-1139, Nov. 1989.
[14] R. Mohan and G. Medioni, "Stereo error detection, correction, and elevation,"IEEE Trans. Patt. Anal. Machine Intell., vol. 11, no. 2, pp. 113-120, Feb. 1989.
[15] S. Menet, P. Saint-Marc, and G. Medioni, "B-snakes: Implementation and application to stereo," inProc. DARPA Image Understanding Workshop(Pittsburgh, PA), Sept. 1990, pp. 720-726.
[16] B. K. P. Horn, "Relative orientation," inProc. DARPA Image Understanding Workshop, Apr. 1988, pp. 826-837.
[17] R. D. Arnold, "Local context in matching edges for stereo vision," inProc. DARPA Image Understanding Workshop, May 1978, pp. 771-791.
[18] S. T. Barnard. "Stochastic stereo matching over scale," inProc. DARPA Image Understanding Workshop, Apr. 1988, pp. 769-778.
[19] N. M. Nasrabadi, Y. Liu, and J. -L. Chiang, "Stereo vision correspondence using a multichannel graph matching technique," inProc. IEEE Int. Conf. Robotics Automat., Apr. 1988.
[20] Y. Ohta and T. Kanade, "Stereo by intra- and inter-scanline search using dynamic programming,"IEEE Trans. Patt. Anal. Machine Intell., vol. PAMI-7, no. 2, pp. 139-154, Mar. 1985.
[21] V. Kratky, "On-line aspects of stereophotogrammetric processing of SPOT images."Photogrammetric Eng. Remote Sens., vol. 55, no. 3, pp. 311-316, Mar. 1989.
[22] E. I. Theodossiou and I. J. Dowman, "Heighting accuracy of SPOT,"Photogrammetric Eng. Remote Sens., vol. 56, no. 12, pp. 1643-1649, Dec. 1990.
[23] D. M. McKeown, "Digital cartography and photo interpretation from a database viewpoint," inNew Applications of Databases(G. Gargarin and E. Golembe, Eds.). New York: Academic, 1984, pp. 19-42.
[24] D. M. McKeown, "The role of artificial intelligence in the integration of remotely sensed data with geographic information systems,"IEEE Trans. Geosci. Remote Sens., vol. GE-25, no. 3, pp. 330-348, May 1987.
[25] H. P. Moravec, "Obstacle avoidance and navigation in the real world by a seeing robot rover," Ph.D. dissertation, Stanford Univ, Stanford, CA, Sept. 1980.
[26] F. P. Perlant and D. M. McKeown, "Scene registration in aerial image analysis,"Photogrammetric Eng. Remote Sens., vol. 56, no. 4, pp. 481-493, Apr. 1990.
[27] Z. Aviad, D. M. McKeown, and Y. Hsieh, "The generation of building hypotheses from monocular views," Tech. Rep., Carnegie-Mellon Univ., Pittsburgh, PA, 1990.
[28] R. B. Irvin and D. M. McKeown, "Methods for exploiting the relationship between buildings and their shadows in aerial imagery,"IEEE Trans. Syst. Man Cybern, vol. 19, no. 6, pp. 1564-1575, Nov. 1989.
[29] D. M. McKeown and J. L. Denlinger, "Cooperative methods for road tracking in aerial imagery," inProc. IEEE Comput. Vision Patt. Recogn. Conf., June 1988, pp. 662-672.
[30] B. D. Lucas, "Generalized image matching by the method of differences," Ph.D dissertation, Carnegie-Mellon Univ., Pittsburgh, PA, July 1984.
[31] D. M. McKeown, C. A. McVay, and B. D. Lucas, "Stereo verification in aerial image analysis,"Optical Eng., vol. 25, no. 3, pp. 333-346, Mar. 1986.
[32] Y. C. Hsieh, D. M. McKeown, and F. P. Perlant, "Performance evaluation of scene registration and stereo matching for cartographic feature extraction," Tech. Rep. CMU-CS-90-193, Sch. Comp. Sci., Nov. 1990.
[33] A. Witkin, D. Terzopoulos, and M. Kass, "Signal matching through scale space,"Int. J. Comput. Vision, pp. 133-144, 1987.
[34] H. H. Baker and T. O. Binford, "Depth from edge and intensity based stereo," inProc. 7th Int. Conf. Artificial Intell., pp. 631-636, Aug. 1981.
[35] Y. -C. Cheng and S. -Y. Lu, "Waveform correlation by tree matching,"IEEE Trans. Patt. Anal. Machine Intell., vol. 7, no. 3, pp. 299-305, May 1985.
[36] W. Hoff and N. Ahuja, "Surface from stereo: Integrating feature matching, disparity estimation, and contour detection,"IEEE Trans. Patt. Anal. Machine Intell., vol. 11, no. 2, pp. 121-136, Feb. 1989.
[37] S. D. Cochran and G. Medioni, "Accurate surface description from binocular stereo, inProc. DARPA Image Understanding Workshop(Palo Alto, CA), May 1989, pp. 857-869.

Index Terms:
3D scene interpretation; area based matching; pattern recognition; remote sensing; stereo matching; cartographic feature extraction; automatic scene registration; S1; SPAM; S2; feature-based matching; hierarchical waveform matching; scene recovery; building disparity estimate; sharpness; scene reference models; cartography; computer vision; computerised pattern recognition; remote sensing
Y.C. Hsieh, D.M. McKeown, F.P. Perlant, "Performance Evaluation of Scene Registration and Stereo Matching for Artographic Feature Extraction," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 14, no. 2, pp. 214-238, Feb. 1992, doi:10.1109/34.121790
Usage of this product signifies your acceptance of the Terms of Use.