This Article 
 Bibliographic References 
 Add to: 
The Recovery and Understanding of a Line Drawing from Indoor Scenes
February 1992 (vol. 14 no. 2)
pp. 298-303

A general procedure for the understanding of a class of indoor scenes is proposed. The suggested algorithm makes use of an extensive 2-D processing of the image that provides a faithful line drawing of the viewed scene. It also uses procedures adequate for the understanding of the 3-D structure and for the recognition of several items in the scene. The approach is specific for indoor scenes, such as corridors, offices, and laboratory rooms, where long straight edges are predominant and vanishing points can be detected.

[1] D. H. Ballard and C. M. Brown,Computer Vision. Englewood Cliffs, NJ: Prentice-Hall, 1982.
[2] S. T. Barnard, "Interpreting perspective images,"Artificial Intell., vol. 21, pp. 435-462, 1983.
[3] M. Barry, D. Cyrluk, D. Kapur, J. Mundy, and V.-D. Nguyen, "A multi-level geometric reasoning system for vision,"Artificial Intell., vol. 37, no. 1-3, pp. 291-332, 1988.
[4] H. G. Barrow and J. M. Tenenbaum, "Interpreting line-drawings as three-dimensional surfaces,"Artificial Intell., vol. 17, pp. 75-116, 1981.
[5] P. Bellutta, G. Collini, A. Verri, and V. Torre, "Recovering 3D information from vanishing points," inProc. IEEE workshop interpretation 3D scenes(Austin, TX), 1989.
[6] H. Nakatani, "Reconstruction of three-dimensional shape using pictorial depth cues," Ph.D. thesis, Dept. Eng., Osaka Univ., Feb. 1986.
[7] R. A. Brooks, "Symbolic reasoning on 3D models and 2D images,"Artificial Intell., vol. 17, pp. 285-348, 1981.
[8] J. F. Canny, "A computational approach to edge detection,"IEEE Trans. Pattern Anal. Machine Intell., vol. PAMI-8, pp. 679-697, 1986.
[9] B. Caprile and V. Torre, "Using vanishing points for TV camera calibration," to be published inInt. J. Comput. Vision, 1990.
[10] M. B. Clowes, "On seeing things,"Artificial Intell., vol. 2, pp. 79-116, 1971.
[11] C. Coelho, M. Straforini, and M. Campani, "A fast and precise method to extract vanishing points," inProc. SPIE's Int. Symp. Applications Opt. Sci. Eng.(Boston), 1990.
[12] E. DeMicheli, B. Caprile, P. Ottonello, and V. Torre, "Localization an noise in edge detection,"IEEE Trans. Patt. Anal. Machine Intell., vol. 11, no. 10, pp. 1106-1116, 1989.
[13] M. Dhome and T. Kasvand, "Polyhedra recognition by hypothesis accumulation,"IEEE Trans. Patt. Anal. Machine Intell., vol. PAMI-9, pp. 429-438, 1987.
[14] A. Fiumicelli and V. Torre, "On the understanding of line drawings,"SPIE, vol. 726 (Intelligent Robots and Computer Vision), 1986.
[15] H. Freeman, "Computer processing of line-drawing images,"Computer Surveys, vol. 6, no. 1, Mar. 1974.
[16] E. F. Freuder, "On the knowledge required to label a picture graph,"Artificial Intell., vol. 15, pp. 1-17, 1980.
[17] R. M. Haralick, "Using perspective transformation in scene analysis,"Comput. Graphics Image Processing, vol. 13, pp. 191-221, 1980.
[18] R. M. Haralick, Y. H. Chu, L. T. Watson, and L. G. Shapiro, "Matching wire frame objects from their two dimensional perspective projections,"Patt. Recogn., vol. 17, no. 6, pp. 607-619, 1984.
[19] R. Horaud, "New methods for matching 3-D objects with single perspective views,"IEEE Trans. Patt. Anal. Machine Intell., vol. PAMI-9, pp. 401-412, May 1987.
[20] D. A. Huffman, "Impossible objects as nonsense sentences," inMachine Intelligence, (B. Mettzer and D. Michie, Eds.), vol. 6, pp. 259-323, 1971.
[21] T. Kanade, "Recovery of the three dimensional shape of an object from a single view,"Artificial Intell., vol. 17, pp. 409-460, 1981.
[22] K. Kanatani, "The constraints on images of rectangular polyhedra,"IEEE Trans Patt. Anal. Machine Intell., vol. PAMI-8, no. 4, pp. 456-463, 1986.
[23] K. Kanatani, "Constraints on length and angle,"Comput. Vision Graphics Image Processing, vol. 41, pp. 28-42, 1988.
[24] D. Kapur and J. L. Mundy, "Geometric reasoning and artificial intelligence: Introduction to the special volume,"Artificial Intell., vol. 37, no. 1, pp. 1-11, 1988.
[25] D. Kapur and J. L. Mundy, "Geometric reasoning and artificial intelligence: Introduction to the special volume,"Artificial Intell., vol. 37, no. 1, pp. 1-11, 1988.
[26] J. R. Kender, "Shape from texture: an aggregation transform that maps a class of texture into surface orientation," inProc. IJCAI6(Tokyo, Japan), Aug. 20-34, 1979, pp. 475-480.
[27] M. J. Magee and J. K. Aggarwal, "Determining vanishing points from perspective images,"Comput. Vision Graphics Image Processing, vol. 26, pp. 256-267, 1984.
[28] A. K. Mackworth, "Interpreting pictures of polyhedral scenes,"Artificial Intell., vol. 4, pp. 121-137, 1973.
[29] J. L. Mundy, "Image understanding research at general electric," inProc. Image Understanding Workshop(Miami Beach, FL), 1985, pp. 83-88.
[30] V. S. Nalwa, "Line-drawing interpretation: A mathematical framework,"Int. J. Comput. Vision, vol. 2, no. 2, pp. 103-124, 1988.
[31] V. S. Nalwa, "Line-drawing interpretation: Straight lines and conic sections,"IEEE Trans. Patt. Anal. Machine Intell., vol. PAMI-10, pp. 514-529, 1988.
[32] L. Pacioli, "De devine proportione," Reprint of Codice Ambrosiano, Fontes Ambrosiani, XXXI, Milano, 1956.
[33] T. Pavlidis,Algorithms for Graphics and Image Processing. Rockville, MD: Computer Science Press, 1982.
[34] Piero della Francesca, "De prospectiva pingendi," Critical Edition, Sansoni, Firenze, 1942.
[35] Quan and R. Mohr, "Determining perspective structures using hierarchical hough transformation,"Patt. Recogn. Lett., vol. 9, pp. 279-286, 1989.
[36] J. Serra,Image Analysis and Mathematical Morphology. London: Academic, 1982.
[37] S. A. Shafer, T. Kanade, and J. Kender, "Gradient space under orthography and perspective,"Comput. Vision Graphics Image Processing, vol. 24, pp. 182-199, 1983.
[38] T. Shakunaga and H. Kaneko, "Perspective angle transform and its application to 3D configuration recovery," inProc. IEEE Conf. Comput. Vision Patt. Recogn.(Miami, FL), 1986, pp. 594-601.
[39] T. Shakunaga and H. Kaneko, "Shape from angles under perspective projection," inProc. 2nd Int. Conf. Comput. Vision(Tampa, FL), 1988.
[40] K. Sugihara, "Mathematical structures of line-drawings of polyhedrons-Towards man-machine communication by means of line-drawings,"IEEE Trans. Patt. Anal. Machine Intell., vol. PAMI-4, pp. 458-469, 1982.
[41] K. Sugihara, "An algebraic approach to Shape-from-Image problems,"Artificial Intell., vol. 23, pp. 59-95, 1984.
[42] E. L. Walker and M. Herman, "Geometric reasoning for constructing 3D scene descriptions from images,"Artificial Intell., vol. 37, pp. 275-290, 1988.
[43] D. Waltz, "Generating semantic descriptions from drawings of scenes with shadows," MAC-AI-TR-271, Mass. Inst. Technol., Cambridge, 1972.
[44] K. Melhorn,Data Structures and Algorithms, vol. 3:Multidimensional Searching and Computational Geometry. New York: Springer-Verlag, 1984.

Index Terms:
2D image processing; 3D structures; pattern recognition; image interpretation; indoor science understanding; image recovery; computer vision; line drawing; vanishing points; computer vision; inference mechanisms; pattern recognition; picture processing
M. Straforini, C. Coelho, M. Campani, V. Torre, "The Recovery and Understanding of a Line Drawing from Indoor Scenes," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 14, no. 2, pp. 298-303, Feb. 1992, doi:10.1109/34.121797
Usage of this product signifies your acceptance of the Terms of Use.