The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.01 - January (2011 vol.33)
pp: 3-15
Jianzhuang Liu , The Chinese University of Hong Kong, Hong Kong
Yu Chen , University of Cambridge, Cambridge
Xiaoou Tang , The Chinese University of Hong Kong, Hong Kong
ABSTRACT
Three-dimensional object reconstruction from a single 2D line drawing is an important problem in computer vision. Many methods have been presented to solve this problem, but they usually fail when the geometric structure of a 3D object becomes complex. In this paper, a novel approach based on a divide-and-conquer strategy is proposed to handle the 3D reconstruction of a planar-faced complex manifold object from its 2D line drawing with hidden lines visible. The approach consists of four steps: 1) identifying the internal faces of the line drawing, 2) decomposing the line drawing into multiple simpler ones based on the internal faces, 3) reconstructing the 3D shapes from these simpler line drawings, and 4) merging the 3D shapes into one complete object represented by the original line drawing. A number of examples are provided to show that our approach can handle 3D reconstruction of more complex objects than previous methods.
INDEX TERMS
3D reconstruction, divide and conquer, internal face, line drawing, manifold.
CITATION
Jianzhuang Liu, Yu Chen, Xiaoou Tang, "Decomposition of Complex Line Drawings with Hidden Lines for 3D Planar-Faced Manifold Object Reconstruction", IEEE Transactions on Pattern Analysis & Machine Intelligence, vol.33, no. 1, pp. 3-15, January 2011, doi:10.1109/TPAMI.2010.49
REFERENCES
[1] Y. Leclerc and M. Fischler, "An Optimization-Based Approach to the Interpretation of Single Line Drawings as 3D Wire Frames," Int'l J. Computer Vision, vol. 9, no. 2, pp. 113-136, 1992.
[2] T. Marill, "Emulating the Human Interpretation of Line-Drawings as Three-Dimensional Objects," Int'l J. Computer Vision, vol. 6, no. 2, pp. 147-161, 1991.
[3] K. Sugihara, "A Necessary and Sufficient Condition for a Picture to Represent a Polyhedral Scene," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 6, no. 5, pp. 578-586, Sept. 1984.
[4] K. Sugihara, Machine Interpretation of Line Drawings. MIT Press, 1986.
[5] L. Ros and F. Thomas, "Overcoming Superstrictness in Line Drawing Interpretation," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 24, no. 4, pp. 456-466, Apr. 2002.
[6] J. Liu and Y. Lee, "A Graph-Based Method for Face Identification from a Single 2D Line Drawing," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 23, no. 10, pp. 1106-1119, Oct. 2001.
[7] J. Liu, Y. Lee, and W.K. Cham, "Identifying Faces in a 2D Line Drawing Representing a Manifold Object," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 24, no. 12, pp. 1579-1593, Dec. 2002.
[8] J. Liu and X. Tang, "Evolutionary Search for Faces from Line Drawings," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 27, no. 6, pp. 861-872, June 2005.
[9] J. Liu, L. Cao, Z. Li, and X. Tang, "Plane-Based Optimization for 3D Object Reconstruction from Single Line Drawings," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 30, no. 2, pp. 315-327, Feb. 2008.
[10] Y. Chen, J. Liu, and X. Tang, "A Divide-and-Conquer Approach to 3D Object Reconstruction from Line Drawings," Proc. IEEE Int'l Conf. Computer Vision, 2007.
[11] K. Shoji, K. Kato, and F. Toyama, "3-D Interpretation of Single Line Drawings Based on Entropy Minimization Principle," Proc. IEEE Conf. Computer Vision and Pattern Recognition, vol. 2, pp. 90-95, 2001.
[12] M. Shpitalni and H. Lipson, "Identification of Faces in a 2D Line Drawing Projection of a Wireframe Object," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 18, no. 10, pp. 1000-1012, Oct. 1996.
[13] S.C. Agarwal and J.W.N. Waggenspack, "Decomposition Method for Extracting Face Topologies from Wireframe Models," Computer-Aided Design, vol. 24, no. 3, pp. 123-140, 1992.
[14] S. Bagali and J. Waggenspack, "A Shortest Path Approach to Wireframe to Solid Model Conversion," Proc. Third Symp. Solid Modeling and Application, pp. 339-349, 1995.
[15] P. Company, M. Contero, J. Conesa, and A. Piquer, "An Optimisation-Based Reconstruction Engine for 3D Modeling by Sketching," Computers & Graphics, vol. 28, pp. 955-979, 2004.
[16] P. Company, A. Piquer, M. Contero, and F. Naya, "A Survey on Geometrical Reconstruction as a Core Technology to Sketch-Based Modeling," Computer & Graphics, vol. 29, no. 6, pp. 892-904, 2005.
[17] P. Debevec, C. Yaylor, and J. Malik, "Modeling and Rendering Architecture from Photograph: A Hybrid Geometry and Image-Based Approach," Proc. ACM SIGGRAPH '96, pp. 11-20, 1996.
[18] H. Lipson and M. Shpitalni, "Optimization-Based Reconstruction of a 3D Object from a Single Freehand Line Drawing," Computer-Aided Design, vol. 28, no. 8, pp. 651-663, 1996.
[19] P. Min, J. Chen, and T. Funkhouser, "A 2D Sketch Interface for a 3D Model Search Engine," Proc. ACM SIGGRAPH '02, Technical Sketches, p. 138, 2002.
[20] A. Turner, D. Chapman, and A. Penn, "Sketching Space," Computer and Graphics, vol. 24, pp. 869-879, 2000.
[21] A. Piquer, R.R. Martin, and P. Company, "Using Skewed Mirror Symmetry for Optimisation-Based 3D Line-Drawing Recognition," Proc. Fifth IAPR Int'l Workshop Graphics Recognition, pp. 182-193, 2003.
[22] S. Ortiz, "3D Searching Starts to Take Shape," Computer, vol. 37, no. 8, pp. 24-26, 2004.
[23] L. Cao, J. Liu, and X. Tang, "3D Object Retrieval Using 2D Line Drawing and Graph Based Relevance Feedback," Proc. ACM Int'l Conf. Multimedia, pp. 105-108, 2006.
[24] M. Clowes, "On Seeing Things," Artificial Intelligence, vol. 2, pp. 79-116, 1971.
[25] D. Huffman, "Impossible Objects as Nonsense Sentences," Machine Intelligence, vol. 6, pp. 295-323, 1971.
[26] K. Sugihara, "An Algebraic Approach to Shape-from-Image Problem," Artificial Intelligence, vol. 23, pp. 59-95, 1984.
[27] M.C. Cooper, "Wireframe Projections: Physical Realisability of Curved Objects and Unambiguous Reconstruction of Simple Polyhedra," Int'l J. Computer Vision, vol. 64, no. 1, pp. 69-88, 2005.
[28] M.C. Cooper, "Constraints between Distant Lines in the Labelling of Line Drawings of Polyhedral Scenes," Int'l J. Computer Vision, vol. 73, no. 2, pp. 195-212, 2007.
[29] M.C. Cooper, "A Rich Discrete Labeling Scheme for Line Drawings of Curved Objects," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 30, no. 4, pp. 741-745, Apr. 2008.
[30] H. Li, Q. Wang, L. Zhao, Y. Chen, and L. Huang, "nD Object Representation and Detection from Single 2D Line Drawing," Lecture Notes in Computer Science, vol. 3519, pp. 363-382. Springer, 2005.
[31] P.A.C. Varley and R.R. Martin, "Estimating Depth from Line Drawings," Proc. Seventh ACM Symp. Solid Modeling and Application, pp. 180-191, 2002.
[32] L. Cao, J. Liu, and X. Tang, "3D Object Reconstruction from a Single 2D Line Drawing without Hidden Lines," Proc. IEEE Int'l Conf. Computer Vision, vol. 1, pp. 272-277, 2005.
[33] L. Cao, J. Liu, and X. Tang, "What the Back of the Object Looks Like: 3D Reconstruction from Line Drawings without Hidden Lines," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 30, no. 3, pp. 507-517, Mar. 2008.
[34] I. Shimshoni and J. Ponce, "Recovering the Shape of Polyhedra Using Line-Drawing Analysis and Complex Reflectance Models," Computer Vision and Image Processing, vol. 65, no. 2, pp. 296-310, 1997.
[35] H. Shimodaira, "A Shape-from-Shading Method of Polyhedral Objects Using Prior Information," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 28, no. 4, pp. 612-624, Apr. 2006.
[36] P.A.C. Varley and R.R. Martin, "A System for Constructing Boundary Representation Solid Models from a Two-Dimensional Sketch—Topology of Hidden Parts," Proc. First UK-Korea Workshop Geometric Modeling and Computer Graphics, pp. 113-128, 2000.
[37] M.A. Armstrong, Basic Topology. Springer, 1983.
[38] D.E. LaCourse, Handbook of Solid Modeling. McGraw-Hill, 1995.
21 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool