This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Part-Based 3D Descriptions of Complex Objects from a Single Image
September 1999 (vol. 21 no. 9)
pp. 835-848

Abstract—Volumetric, 3D, part-based descriptions of complex objects in a scene can be highly beneficial for many tasks such as generic object recognition, navigation, and manipulation. However, it has been difficult to derive such descriptions from image data. There has been some progress in getting such descriptions from range data or from perfect contours, but analysis of a real intensity image presents many difficulties. The object and part boundaries do not completely correspond to image boundaries. The detected boundaries are often fragmented and many boundaries due to surface markings, shadows, and noise are present. In addition, inference of 3D from a 2D image is difficult. This paper describes a method to compute the desired descriptions from a single image by exploiting projective properties of a class of generalized cylinders and of possible joints between them. Experimental results on some examples are given.

[1] I. Bergevin and M.D. Levine, "Generic Object Recognition: Building and Matching Coarse Descriptions from Line Drawings," IEEE Trans. Pattern Recognition and Machine Intelligence, vol. 15, no. 1, pp. 19-36, Jan. 1993.
[2] I. Biederman, “Recognition by Components: A Theory of Human Image Understanding,” Psychological Review, vol. 94, no. 2, pp. 115-147, 1987.
[3] T.O. Binford, “Visual Perception by Computer,” IEEE Conf. Systems and Controls, Miami, Fla., Dec. 1971.
[4] R.A. Brooks, “Model-Based Three-Dimensional Interpretations of Two-Dimensional Images,” IEEE Trans. Pattern Analysis and Machine Intellligence, vol. 5, no. 2, pp. 140-150, 1983.
[5] S.J. Dickinson, A.P. Pentland, and A. Rosenfeld, "3D Shape Recovery Using Distributed Aspect Matching," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 14, no. 2, pp. 174-198, Feb. 1992.
[6] S.J. Dickinson, D. Metaxas, and A. Pentland, “The Role of Model-Based Segmentation in the Recovery of Volumetric Parts from Range Data,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 19, no. 3, pp. 259-267, 1997.
[7] A. Lejeune and F.P. Ferrie, “Finding the Parts of Objects in Range Images,” Computer Vision and Image Understanding, vol. 64, no. 2, pp. 230-247, Sept. 1996.
[8] A. Gross and T. Boult, "Recovery of Generalized Cylinders From a Single Intensity View," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 18, no. 2, pp. 161-180, Feb. 1996.
[9] J.E. Hummel and I. Biederman, “Dynamic Binding in a Neural Network for Shape Recognition” Psychological Review, 1992.
[10] J. Malik, “Interpreting Line Drawings of Curved Objects,” Int'l J. Computer Vision, vol. 1, no. 1, pp. 73-103, 1987.
[11] D. Marr and H.K. Nishihara, “Representation and Recognition of the Spatial Organization of Three-Dimensional Shapes,” Proc. Royal Physical Soc., pp. 269-294, 1977.
[12] R. Mohan and R. Nevatia, "Perceptual Organization for Scene Segmentation and Description," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 14, no. 6, pp. 616-635, June 1992.
[13] V.S. Nalwa, “Line-Drawing Interpretation: Bilateral Symmetry,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 11, no. 10, pp. 1117-1120, Oct. 1989.
[14] R. Nevatia and T.O. Binford, “Description and Recognition of Complex Curved Objects,” Artificial Intelligence, vol. 8, no. 1, pp. 77-98, 1977.
[15] Q.L. Nguyen and M.D. Levine, “Representing 3D Objects in Range Images Using Geons,” Computer Vision and Image Understanding, vol. 63, no. 1, pp. 158-168, Jan. 1996.
[16] A. Pentland, “Recognition by Parts,” Proc. Int'l Conf. Computer Vision, ICCV, pp. 612-620, 1987.
[17] K. Rao and R. Nevatia, “Describing and Segmenting Scenes from Imperfect and Incomplete Data,” Computer Vision, Graphics and Image Processing J., vol. 57, no. 1, pp. 1-23, Jan. 1993,
[18] L. Roberts, Machine Perception of Three-Dimensional Solids. Cambridge, Mass.: Massachusetts Institute of Technology Press, 1965.
[19] H. Sato and T.O. Binford, “Finding and Recovering SHGC Objects in an Edge Image,” Computer Vision Graphics and Image Processing, vol. 57, no. 3, pp. 346-356, 1993.
[20] F. Ulupinar and R. Nevatia, "Perception of 3-D surfaces From 2-D Contours," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 15, no. 1, pp. 3-18, Jan. 1993.
[21] F. Ulupinar and R. Nevatia, “Recovery of 3D Objects with Multiple Curved Surfaces from 2D Contours,” Artificial Intelligence, vol. 67, no. 1, pp. 1-28, May 1994.
[22] F. Ulupinar and R. Nevatia, "Shape From Contour: Straight Homogeneous Generalized Cylinders and Constant Cross Section Generalized Cylinders," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 17, no. 2, pp. 120-135, Feb. 1995.
[23] M. Zerroug and R. Nevatia, “Volumetric Descriptions from a Single Intensity Image,” Int'l J. Computer Vision, pp. 11-42, Oct. 1996.
[24] M. Zerroug and R. Nevatia, Three-Dimensional Descriptions Based on the Analysis of the Invariant and Quasi-Invariant Properties of some Curved-Axis Generalized Cylinders IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 18, no. 3, pp. 237-253, Mar. 1996.

Index Terms:
3D shape descriptions, part-based representations, object segmentation.
Citation:
M. Zerroug, R. Nevatia, "Part-Based 3D Descriptions of Complex Objects from a Single Image," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 21, no. 9, pp. 835-848, Sept. 1999, doi:10.1109/34.790426
Usage of this product signifies your acceptance of the Terms of Use.