This Article 
 Bibliographic References 
 Add to: 
Knowledge-Directed Interpretation of Mechanical Engineering Drawings
September 1992 (vol. 14 no. 9)
pp. 928-940

A methodology for the interpretation of images of engineering drawings is presented. The approach is based on the combination of schemata describing prototypical drawing constructs with a library of low-level image analysis routines and a set of explicit control rules applied by an LR(1) parser. The resulting system (Anon) integrates bottom-up and top-down processing strategies within a single, flexible framework modeled on the human perceptual cycle. Anon's structure and operation are described and discussed, and examples of its interpretation of real mechanical drawings are shown.

[1] J. Hofer-Alfeis, "Automated conversion of existing mechanical engineering drawings to CAD data structures: State of the art,"CAPE '86: Conf. Comput. Applications Production Eng.(Copenhagen) 1986.
[2] M. Karima, K. S. Sadhal, and T. O. McNeil, "From paper drawings to computer-aided design,"IEEE Comput. Graphics Applications, pp. 27-39, Feb. 1985.
[3] J. S. Weszka and A. Rosenfeld, "Histogram modification for threshold selection,"IEEE Trans. Syst. Man. Cybern., vol. 9, pp. 38-52, 1979.
[4] J. Kittler, J. Illingworth, and J. Foglein, "Threshold selection based on a simple image statistic,"Comput. Vision Graphics Image Processing, vol. 30, pp. 125-147, 1985.
[5] R. W. Smith, "Computer processing of line images: A survey,"Patt. Recog., vol. 20, pp. 7-15, 1987.
[6] W. Black, T. P. Clement, J. F. Harris, B. Llewellyn, and G. Preston, "A general purpose follower for line structured data,"Patt. Recogn., vol. 14, pp. 33-42, 1981.
[7] T. Pavlidis, "A vectorizer and feature extractor for document recognition,"Comput. Vision Graphics, Image Processing, vol. 35, pp. 111-127, 1986.
[8] X. Lin, S. Shimotsuji, M. Minoh, and T. Sakai, "Efficient diagram understanding with characteristic pattern detection,"Comput. Vision Graphics Image Processing, vol. 30, pp. 107-120, 1985.
[9] D. S. Tudhope and J. V. Oldfield, "A high-level recognizer for schematic diagrams,"IEEE Comput. Graphics Applications, pp. 33-40, 1983.
[10] H. Bley, "Segmentation and preprocessing of electrical schematics using picture graphs,"Comput. Vision Graphics Image Processing, vo1. 28, pp. 271-288, 1984.
[11] H. Bunke, "Experience with several methods for the analysis of schematic diagrams," inProc. 6th Int. Conf. Patt. Recogn. IEEE Comput. Soc., 1982, pp. 710-712.
[12] K. Iwata, M. Yamamoto, and M. Iwasaki, "Recognition system for three-view mechanical drawings,"Lecture Notes Comput. Sci., vol. 31, pp. 240-249, 1988.
[13] D. Dori, and A. Pnueli, "The grammar of dimensions in machine drawings,"Comput. Vision Graphics Image Processing, vol. 42, pp. 1-18, 1988.
[14] D. Dori, "A syntactic/geometric approach to recognition of dimensions in engineering machine drawings,"Comput. Vision Graphics Image Processing, vol. 47, pp. 271-292, 1989.
[15] L. A. Fletcher and R. Kasturi, "A robust algorithm for text string separation from mixed text/graphics images,"IEEE Patt. Anal. Machine Intell., vol. 10, pp. 910-918, 1988.
[16] R. Kasturi, R. Raman, C. Chennubhotla, and L. O'Gorman, "Document image analysis: An overview of techniques for graphic recognition," inProc SSPR90(Murray Hill, NJ), 1990, pp. 192-230.
[17] M. A. Wesley and G. Markowsky, "Fleshing out projections,"IBM J. Res. Devel., vol. 25, pp. 934-954, 1981.
[18] R. M. Haralick and D. Queeney, "Understanding engineering drawings,"Comput. Graphics Image Processing, vol. 20, pp. 244-280, 1982.
[19] K. Preiss, "Constructing the solid representation from engineering projections,"Comput. Graphics, vol. 8, no. 4, pp. 381-389, 1984.
[20] S. H. Joseph, T. P. Pridmore, and M. E. Dunn, "Toward the automatic interpretation of mechanical engineering drawings," to be published inComputer Vision and Image Processing(A. Bartlett, Ed.). New York: Kogan Page, 1989.
[21] T. O. Binford, "A survey of model-based image analysis systems,"Int. J. Robotics Res., vol. 1, pp. 18-63, 1982.
[22] J. A. Mulder, A. K. Mackworth, and W. S. Havens, "Knowledge structuring and constraint satisfaction: The MAPSEE approach," Tech. Rep. 87-21, Dept. Comput. Sci., Univ. British Columbia, Vancouver, Canada, 1987.
[23] M. Nagao, T. Matsuyama, and H. Mori, "Structural analysis of complex aerial photographs,"Proc. 6th IJCAI, 1979, pp. 610-616.
[24] J. A. Mulder, "Discrimination vision,"Comput. Vision Graphics Image Processing, vol. 43, pp. 313-336, 1988.
[25] D. M. McKeown, W. A. Harvey, and J. McDermott, "Rule-based interpretation of aerial imagery,"IEEE Patt. Anal. Machine Intell.vol. PAMI-7, pp. 570-585, 1985.
[26] T. Sakai, T. Kanade, and Y. Ohta, "Model-based interpretation of outdoor scenes," inProc. 3rd IJCPR, 1976, pp. 581-585.
[27] T. Matsuyama and V. Hwang, "SIGMA: A framework for image understanding--Integration of bottom-up and top-down analyses," inProc. 9th IJCAI, 1985, pp. 908-915.
[28] C. A. Kohl, A. R. Hanson, and E. M. Riseman, "A goal-directed intermediate level executive for image interpretation," inProc. 10th IJCAI, 1987, pp. 811-814.
[29] T. Matsuyama and T. S. -S. Hwang,"SIGMA: A Knowledge-Based Aerial Image Understanding System. New York: Plenum, 1990.
[30] A. K. Mackworth, "Vision research strategy: Black magic, metaphors, mechanisms, miniworlds, and maps," inComputer Vision Systems(A. Hanson and E. M. Riseman, Eds.). New York: Academic, 1978.
[31] D. G. Elliman and I. T. Lancaster, "A review of segmentation and contextual analysis techniques required for automatic text recognition," to be published inPatt. Recogn..
[32] B. W. Kernighan and D. M. Ritchie,The C Programming Language. Englewood Cliffs, NJ: Prentice-Hall, 1978.
[33] S. H. Joseph, "Segmentation and aggregation of text from images of mixed text and graphics," inResearch in Informatics, vol. 5(Reinhard Klette, Ed.). Akademie Verlag, 1991, pp. 265-271.
[34] S. H. Joseph, "Tracking lines through noise," inProc. IEE 3rd Int. Conf. Image Processing(Univ. of Warwick), 1989.
[35] S. J. Cheetham, "The automatic extraction and classification of curves from conventional line drawings," Ph.D. thesis, Univ. of Sheffield, 1988.
[36] M. E. Dunn and S. H. Joseph, "Processing of poor quality line drawings by local estimation of noise,"Lecture Notes Comput. Sci.vol. 31, pp. 153-162, 1988.
[37] M. Yachida, M. Ikeda, and S. Tsuji, "A knowledge-directed line finder for analysis of complex scenes," inProc. 6th IJCAI, 1979, pp. 984-991.
[38] U. Neisser,Cognition and Reality: Principles and Implications of Cognitive Psychology. San Francisco: W. H. Freeman, 1976.
[39] S. C. Johnson, "Yacc--Yet another compiler compiler," Comp. Sci. Tech. Rep. 32, Bell Lab., Murray Hill, NJ, 1975.
[40] T. C. Henderson and A. Samal, "Shape grammar compilers,"Patt. Recogn., vol. 19, pp. 279-288, 1986.
[41] A. R. Rao and A. K. Jain, "Knowledge representation and control in computer vision systems,"IEEE Expert, pp. 64-79, Spring 1988.
[42] D. M. McKeown, W. A. Harvey, and L. E. Wixson, "Automating knowledge acquisition for aerial image interpretation,"Comput. Vision Graphics Image Processing, vol. 46, pp. 37-81, 1989.
[43] R. A. Brooks, "Symbolic reasoning among 3D models and 2D images,"Artificial Intell.vol. 17, pp. 285-348, 1981.
[44] J. McDermott, "Making expert systems explicit," inInformation Processing '86(H. J. Kugler, Ed.). Amsterdam: Elsevier (North-Holland), 1986.
[45] T. P. Pridmore and S. H. Joseph, "Integrating visual search with visual memory in a knowledge-directed image interpretation system," inProc. BMVC90(Oxford), 1990, pp. 367-373.
[46] H. Tropf and I. Walter, "An ATN model for recognition of solids in single images," inProc. 8th IJCAI, 1983, pp 1094-1097.
[47] H. Tropf, "Analysis-by-synthesis search for semantic segmentation applied to workpiece recognition," inProc 5th ICPR, 1980, pp. 241-244.
[48] W. Hattich, "Recognition of overlapping workpieces by model directed construction of object contours,"Digital Syst. Industrial Automat., vol. 1, nos. 2-3, pp. 223-239, 1982.
[49] J. Glicksman, "Using multiple information sources in a computational vision system," inProc. 8th IJCAI, 1983, pp. 1078-1080.
[50] A. R. Hanson, and E. M. Riseman, "VISIONS: A computer system for interpreting scenes," inComputer Vision Systems(A. Hanson and E. Riseman, Eds.). New York: Academic, 1978.
[51] A. M. Nazif and M. D. Levine, "Low-level image segmentation and expert system,"IEEE Trans. Patt. Anal. Machine Intell., vol. PAMI-6, pp. 555-577, 1984.

Index Terms:
image interpretation; knowledge directed interpretation; bottom-up processing; mechanical engineering drawings; LR(1) parser; top-down processing; human perceptual cycle; Anon's structure; computerised pattern recognition; knowledge engineering; mechanical engineering computing
S.H. Joseph, T.P. Pridmore, "Knowledge-Directed Interpretation of Mechanical Engineering Drawings," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 14, no. 9, pp. 928-940, Sept. 1992, doi:10.1109/34.161351
Usage of this product signifies your acceptance of the Terms of Use.