Subscribe
Issue No.08 - August (2009 vol.31)
pp: 1444-1457
Tong Lu , Nanjing University, Nanjing
Chiew-Lan Tai , Hong Kong University of Science and Technology, Hong Kong
Huafei Yang , Nanjing University, Nanjing
Shijie Cai , Nanjing University, Nanjing
ABSTRACT
We present a novel knowledge-based system to automatically convert real-life engineering drawings to content-oriented high-level descriptions. The proposed method essentially turns the complex interpretation process into two parts: knowledge representation and knowledge-based interpretation. We propose a new hierarchical descriptor-based knowledge representation method to organize the various types of engineering objects and their complex high-level relations. The descriptors are defined using an Extended Backus Naur Form (EBNF), facilitating modification and maintenance. When interpreting a set of related engineering drawings, the knowledge-based interpretation system first constructs an EBNF-tree from the knowledge representation file, then searches for potential engineering objects guided by a depth-first order of the nodes in the EBNF-tree. Experimental results and comparisons with other interpretation systems demonstrate that our knowledge-based system is accurate and robust for high-level interpretation of complex real-life engineering projects.
INDEX TERMS
Knowledge representation, interpretation, engineering drawings, high-level analysis, graphics recognition.
CITATION
Tong Lu, Chiew-Lan Tai, Huafei Yang, Shijie Cai, "A Novel Knowledge-Based System for Interpreting Complex Engineering Drawings: Theory, Representation, and Implementation", IEEE Transactions on Pattern Analysis & Machine Intelligence, vol.31, no. 8, pp. 1444-1457, August 2009, doi:10.1109/TPAMI.2008.161
REFERENCES
[1] A. Cardone, S.K. Gupta, and M.V. Karnik, “A Survey of Shape Similarity Assessment Algorithms for Product Design and Manufacturing Applications,” J. Computing and Information Science in Eng., vol. 3, no. 2, pp. 109-118, 2003.
[2] D.G. Ullman, The Mechanical Design Process, second ed. McGraw-Hill, 1997.
[3] K. Tombre, “Ten Years of Research in the Analysis of Graphics Documents: Achievements and Open Problems,” Proc. 10th Portuguese Conf. Pattern Recognition, pp. 11-17, 1998.
[4] K. Tombre, “Analysis of Engineering Drawings: State of the Art and Challenges,” Lecture Notes in Computer Science, vol. 1389, pp.257-264, 1998.
[5] T. Kanungo, R-M. Haralick, and D. Dori, “Understanding Engineering Drawings: A Survey,” Proc. First IAPR Int'l Workshop Graphics Recognition, pp. 217-228, 1995.
[6] X. Hilaire and K. Tombre, “Robust and Accurate Vectorization of Line Drawings,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 28, no. 6, pp. 890-904, June 2006.
[7] Y. Zheng, H. Li, and D. Doermann, “A Parallel-Line Detection Algorithm Based on HMM Decoding,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 27, no. 5, pp. 777-792, May 2005.
[8] Y.H. Yu, A. Samal, and S.C. Seth, “A System for Recognizing a Large Class of Engineering Drawings,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 19, no. 8, pp. 868-890, Aug. 1997.
[9] J.Y. Chiang et al., “A New Algorithm for Line Image Vectorization,” Pattern Recognition, vol. 31, no. 10, pp. 1541-1549, 1998.
[10] D. Dori and W. Liu, “Sparse Pixel Vectorization: An Algorithm and Its Performance Evaluation,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 21, no. 3, pp. 202-215, Mar. 1999.
[11] W.Y. Liu and D. Dori, “Incremental Arc Segmentation Algorithms and Its Evaluation,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 20, no. 4, pp. 424-431, Apr. 1998.
[12] E. Bodansky and M. Pilouk, “Using Local Deviations of Vectorization to Enhance the Performance of Raster-to-Vector Conversion Systems,” Int'l J. Document Analysis and Recognition, vol. 3, no. 2, pp. 67-72, 2000.
[13] Y. Chen, N.A. Langrana, and A.K. Das, “Perfecting Vectorized Mechanical Drawings,” Computer Vision and Image Understanding, vol. 63, no. 2, pp. 273-286, 1996.
[14] R. Kasturi, S.T. Bow, W. El-Masri, J. Shah, J.R. Gattiker, and U.B. Mokate, “A System for Interpretation of Line Drawings,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 12, no. 10, pp.978-992, Oct. 1990.
[15] R.W. Smith, “Computer Processing of Line Images: A Survey,” Pattern Recognition, vol. 20, no. 1, pp. 7-15, 1987.
[16] S.H. Joseph and T.P. Pridmore, “Knowledge-Directed Interpretation of Mechanical Engineering Drawings,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 14, no. 9, pp. 928-940, Sept. 1992.
[17] K.H. Lee, Y.C. Choy, and S.B. Cho, “Geometric Structure Analysis of Document Images: A Knowledge-Based Approach,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 22, no. 11, pp. 1224-1240, Nov. 2000.
[18] J.Q. Song, F. Su, J.B. Chen, and S.J. Cai, “A Knowledge-Aided Line Network Oriented Vectorization Method for Engineering Drawings,” Pattern Analysis and Application, vol. 3, no. 2, pp. 142-152, 2000.
[19] P. Vaxivière and K. Tombre, “CELESSTIN IV: Knowledge-Based Analysis of Mechanical Engineering Drawings,” Proc. IEEE Int'l Conf. System Eng., pp. 242-245, 1992.
[20] J. Cherneff, R. Logcher, J. Connor, and N. Patrikalakis, “Knowledge-Based Interpretation of Architectural Drawings,” Research in Eng. Design, vol. 3, no. 4, pp. 195-210, 1992.
[21] Y.Q. Cheng and J.Y. Yang, “A Knowledge-Based Graphic Description Tool for Understanding Engineering Drawings,” Proc. First Int'l Conf. Systems Integration, pp. 302-309, 1990.
[22] J.Q. Song, M.R. Lyu, and S.J. Cai, “Effective Multiresolution Arc Segmentation: Algorithms and Performance Evaluation,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 26, no. 11, pp.1491-1506, Nov. 2004.
[23] J.Q. Song, F. Su, C.L. Tai, and S.J. Cai, “An Object-Oriented Progressive-Simplification-Based Vectorization System for Engineering Drawing: Model, Algorithm, and Performance,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 24, no. 8, pp.1048-1060, Aug. 2002.
[24] J.Q. Song, F. Su, J.B. Chen, and S.J. Cai, “A Highly Efficient Global Vectorization Method for Line Drawings,” Proc. Third IAPR Int'l Workshop Graphics Recognition, pp. 32-37, 1999.
[25] J.Q. Song, F. Su, C.L. Tai, J.B. Chen, and S.J. Cai, “Line Net Global Vectorization: An Algorithm and Its Performance Evaluation,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, vol. 1, pp.383-388, 2000.
[26] F. Su, J.Q. Song, C.L. Tai, and S.J. Cai, “Dimension Recognition and Geometry Reconstruction in Vectorization of Engineering Drawings,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 710-716, 2001.
[27] B. Coüasnon, “DMOS, a Generic Document Recognition Method: Application to Table Structure Analysis in a General and in a Specific Way,” Int'l J. Document Analysis and Recognition, vol. 8, no. 2, pp. 111-122, 2006.
[28] B. Coüasnon, J. Camillerapp, and I. Leplumey, “Access by Content to Handwritten Archive Documents: Generic Document Recognition Method and Platform for Annotations,” Int'l J. Document Analysis and Recognition, vol. 9, nos. 2-4, pp. 223-242, 2007.
[29] B. Coüasnon, “Dealing with Noise in DMOS, a Generic Method for Structured Document Recognition: An Example on a Complete Grammar,” Lecture Notes in Computer Science, vol. 3088, pp. 38-49, 2004.
[30] O. Bimber, L.M. Encarnao, and A. Stork, “A Multi-Layered Architecture for Sketch-Based Interaction within Virtual Environments,” Computers and Graphics, vol. 2, no. 6, pp. 851-867, 2000.
[31] A. Caetano, N. Goulart, M. Fonseca, and J. Jorge, “Javasketchit: Issues in Sketching the Look of User Interfaces,” Proc. AAAI Spring Symp. Sketch Understanding, pp. 9-14, 2002.
[32] J.V. Mahoney and M.P.J. Fromherz, “Three Main Concerns in Sketch Recognition and an Approach to Addressing Them,” Proc. AAAI Spring Symp. Sketch Understanding, pp. 105-112, 2002.
[33] C.J. Su and F. Lin, “Syntactic Interpretation Approaches for Innovative Engineering Drawings Conversion Support System,” Computers and Industrial Eng., vol. 35, nos. 3-4, pp. 635-638, 1998.
[34] Q. Ji and M.M. Marefat, “Machine Interpretation of CAD Data for Manufacturing Applications,” ACM Computing Surveys, vol. 24, no. 3, pp. 264-311, 1997.
[35] G.S. Zhi, S.M. Lo, and Z. Fang, “A Graph-Based Algorithm for Extracting Units and Loops from Architectural Floor Plans for a Building Evacuation Model,” Computer-Aided Design, vol. 35, no. 1, pp. 1-14, 2003.
[36] P. Dosch, K. Tombre, C. Ah-Soon, and G. Masini, “A Complete System for Analysis of Architectural Drawings,” Int'l J. Document Analysis and Recognition, vol. 3, no. 2, pp. 102-116, 2000.
[37] B.S. Prabhu and S.S. Pande, “Intelligent Interpretation of CADD Drawings,” Computers and Graphics, vol. 23, no. 1, pp. 25-44, 1999.
[38] T. Lu, C.L. Tai, F. Su, and S.J. Cai, “A New Recognition Model for Electronic Architectural Drawings,” Computer-Aided Design, vol. 37, no. 10, pp. 1053-1069, 2005.
[39] T. Lu, C.L. Tai, L. Bao, F. Su, and S.J. Cai, “3D Reconstruction of Detailed Buildings from Architectural Drawings,” Computer-Aided Design and Applications, vol. 2, nos. 1-4, pp. 527-536, 2005.
[40] J.Y. Ramel and N. Vincent, “Strategy for Line Drawing Understanding,” Lecture Notes in Computer Science, vol. 3088, pp. 1-12, 2004.
[41] T.P. Pridmore, A. Darwish, and D. Elliman, “Interpreting Line Drawing Images: A Knowledge Level Perspective,” Lecture Notes in Computer Science, vol. 2390, pp. 245-255, 2002.
[42] R.D.T. Janssen and A.M. Vossepoel, “Adaptive Vectorization of Line Drawing Images,” Computer Vision and Image Understanding, vol. 65, no. 1, pp. 38-56, 1997.
[43] O. Hori and S. Tanigawa, “Rastor-to-Vector Conversion by Line Fitting Based on Contours and Skeletons,” Proc. Int'l Conf. Document Analysis and Recognition, pp. 272-281, 1993.
[44] J.B. Roseborough and H. Murase, “Partial Eignenvalue Decomposition for Large Image Sets Using Run-Length Encoding,” Pattern Recognition, vol. 28, no. 3, pp. 421-430, 1995.
[45] D. Dori and W.Y. Liu, “Automated CAD Conversion with the Machine Drawing Understanding System: Concepts, Algorithms, and Performance,” IEEE Trans. Systems, Man, and Cybernetics— Part A: Systems and Humans, vol. 29, no. 4, pp. 411-416, 1999.
[46] D. Crevier and R. Lepage, “Knowledge-Based Image Understanding Systems: A Survey,” Computer Vision and Image Understanding, vol. 67, no. 2, pp. 161-185, 1997.
[47] T. Lu, H.F. Yang, R.Y. Yang, and S.J. Cai, “Automatic Analysis and Integration of Architectural Drawings,” Int'l J. Document Analysis and Recognition, vol. 9, no. 1, pp. 31-47, 2007.
[48] H.F. Yang, R.Y. Yang, T. Lu, and S.J. Cai, “The Hierarchical Feature Extraction Approach for Symbol Recognition in Construction Engineering Drawings,” Proc. Sixth IAPR Int'l Workshop Graphics Recognition, pp. 46-55, 2005.