This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Generic Model Abstraction from Examples
July 2005 (vol. 27 no. 7)
pp. 1141-1156
The recognition community has typically avoided bridging the representational gap between traditional, low-level image features and generic models. Instead, the gap has been artificially eliminated by either bringing the image closer to the models using simple scenes containing idealized, textureless objects or by bringing the models closer to the images using 3D CAD model templates or 2D appearance model templates. In this paper, we attempt to bridge the representational gap for the domain of model acquisition. Specifically, we address the problem of automatically acquiring a generic 2D view-based class model from a set of images, each containing an exemplar object belonging to that class. We introduce a novel graph-theoretical formulation of the problem in which we search for the lowest common abstraction among a set of lattices, each representing the space of all possible region groupings in a region adjacency graph representation of an input image. The problem is intractable and we present a shortest path-based approximation algorithm to yield an efficient solution. We demonstrate the approach on real imagery.

[1] R. Basri, L. Costa, D. Geiger, and D. Jacobs, “Determining the Similarity of Deformable Shapes,” Proc. Int'l Conf. Computer Vision Workshop Physics-Based Modeling in Computer Vision, pp. 135-143, 1995.
[2] S. Belongie, J. Malik, and J. Puzicha, “Shape Matching and Object Recognition Using Shape Contexts,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 24, no. 4, pp. 509-522, Apr. 2002.
[3] R. Bergevin and M.D. Levine, “Generic Object Recognition: Building and Matching Coarse Descriptions from Line Drawings,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 15, no. 1, pp. 19-36, Jan. 1993.
[4] I. Biederman, “Human Image Understanding: Recent Research and a Theory,” Computer Vision, Graphics, and Image Processing, vol. 32, pp. 29-73, 1985.
[5] R. Brooks, “Model-Based 3-D Interpretations of 2-D Images,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 5, no. 2, pp. 140-150, 1983.
[6] G. Carneiro and A. Jepson, “Local Phase-Based Features,” Proc. European Conf. Computer Vision, 2002.
[7] D. Comaniciu and P. Meer, “Robust Analysis of Feature Spaces: Color Image Segmentation,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 750-755, 1997.
[8] J. Connell and M. Brady, “Generating and Generalizing Models of Visual Objects,” Artificial Intelligence, vol. 31, pp. 159-183, 1987.
[9] T.H. Cormen, C.E. Leiserson, and R.L. Rivest, Introduction to Algorithms, chapter 25. MIT Press, 1993.
[10] S. Dickinson, H. Christensen, J. Tsotsos, and G. Olofsson, “Active Object Recognition Integrating Attention and Viewpoint Control,” Computer Vision and Image Understanding, vol. 67, no. 3, pp. 239-260, Sept. 1997.
[11] S. Dickinson and D. Metaxas, “Integrating Qualitative and Quantitative Shape Recovery,” Int'l J. Computer Vision, vol. 13, no. 3, pp. 1-20, 1994.
[12] S. Dickinson, D. Metaxas, and A. Pentland, “The Role of Model-Based Segmentation in the Recovery of Volumetric Parts from Range Data,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 19, no. 3, pp. 259-267, Mar. 1997.
[13] S. Dickinson, A. Pentland, and A. Rosenfeld, “From Volumes to Views: An Approach to 3-D Object Recognition,” Computer Graphics, Vision, and Image Processing: Image Understanding, vol. 55, no. 2, pp. 130-154, 1992.
[14] S. Dickinson, A. Pentland, and A. Rosenfeld, “3-D Shape Recovery Using Distributed Aspect Matching,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 14, no. 2, pp. 174-198, Feb. 1992.
[15] D. Eppstein, “Finding the $k$ Shortest Paths,” SIAM J. Computing, vol. 28, no. 2, pp. 652-673, 1999.
[16] G. Ettinger, “Large Hierarchical Object Recognition Using Libraries of Parameterized Model Sub-Parts,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 32-41, 1988.
[17] L. Fei-Fei, R. Fergus, and P. Perona, “Learning Generative Visual Models from Few Training Examples: An Incremental Bayesian Approach Tested on 101 Object Categories,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, June 2004.
[18] P. Felzenszwalb and D. Huttenlocher, “Image Segmentation Using Local Variation,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 98-104, 1998.
[19] F. Ferrie, J. Lagarde, and P. Whaite, “Darboux Frames, Snakes, and Super-Quadrics: Geometry from the Bottom Up,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 15, no. 8, pp. 771-784, Aug. 1993.
[20] R. Gould, Graph Theory, pp. 170-172. Benjamin/Cummings, 1988.
[21] J. Han and M. Kamber, Data Mining: Concepts and Techniques, p. 228. Morgan Kaufmann, 2001.
[22] D. Huttenlocher and S. Ullman, “Recognizing Solid Objects by Alignment with an Image,” Int'l J. Computer Vision, vol. 5, no. 2, pp. 195-212, 1990.
[23] X. Jiang, A. Munger, and H. Bunke, “On Median Graphs: Properties, Algorithms, and Applications,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 23, no. 10, Oct. 2001.
[24] J.-M. Jolion, “The Deviation of a Set of Strings,” Pattern Analysis and Applications, vol. 6, no. 3, pp. 224-231, 2003.
[25] N Katoh, T. Ibaraki, and H. Mine, “An Efficient Algorithm for $k$ Shortest Simple Paths,” Networks, vol. 12, pp. 411-427, 1982.
[26] Y. Keselman and S. Dickinson, “Bridging the Representation Gap between Models and Exemplars,” Proc. IEEE Workshop Models versus Exemplars in Computer Vision, Dec. 2001.
[27] Y. Keselman and S. Dickinson, “Generic Model Abstraction from Examples,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, vol. 1, pp. 856-863, Dec. 2001.
[28] B.B. Kimia, A. Tannenbaum, and S.W. Zucker, “Shape, Shocks, and Deformations I: The Components of Two-Dimensional Shape and the Reaction-Diffusion Space,” Int'l J. Computer Vision, vol. 15, pp. 189-224, 1995.
[29] W.G. Kropatsch, “Building Irregular Pyramids by Dual Graph Contraction,” Proc. IEEE Vision, Image and Signal Processing, vol. 142, no. 6, pp. 366-374, 1995.
[30] B. Leibe and B. Schiele, “Analyzing Appearance and Contour Based Methods for Object Categorization,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2003.
[31] A. Leonardis and H. Bischof, “Dealing with Occlusions in the Eigenspace Approach,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 453-458, June 1996.
[32] D. Lowe, Perceptual Organization and Visual Recognition. Kluwer Academic, 1985.
[33] D. Lowe, “Object Recognition from Local Scale-Invariant Features,” Proc. Int'l Conf. Computer Vision, pp. 1150-1157, 1999.
[34] B. Luo, R. Wilson, and E. Hancock, “Spectral Embedding of Graphs,” Pattern Recognition, 2004.
[35] A. Mohan, C. Papageorgiou, and T. Poggio, “Example-Based Object Detection in Images by Components,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 23, no. 4, pp. 349-361, Apr. 2001.
[36] H. Murase and S. Nayar, “Visual Learning and Recognition of 3-D Objects from Appearance,” Int'l J. Computer Vision, vol. 14, pp. 5-24, 1995.
[37] R. Nelson and A. Selinger, “A Cubist Approach to Object Recognition,” Proc. IEEE Int'l Conf. Computer Vision, Jan. 1998.
[38] H. Nishida and S. Mori, “An Algebraic Approach to Automatic Construction of Structural Models,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 15, no. 12, pp. 1298-1311, Dec. 1993.
[39] M. Pelillo, K. Siddiqi, and S. Zucker, “Matching Hierarchical Structures Using Association Graphs,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 21, no. 11, pp. 1105-1120, Nov. 1999.
[40] A. Pentland, “Perceptual Organization and the Representation of Natural Form,” Artificial Intelligence, vol. 28, pp. 293-331, 1986.
[41] A. Pentland, “Automatic Extraction of Deformable Part Models,” Int'l J. Computer Vision, vol. 4, pp. 107-126, 1990.
[42] A. Pope and D. Lowe, “Learning Object Recognition Models from Images,” Proc. IEEE Int'l Conf. Computer Vision, pp. 296-301, 1993.
[43] E. Rivlin, S. Dickinson, and A. Rosenfeld, “Recognition by Functional Parts,” Computer Vision and Image Understanding, vol. 62, no. 2, pp. 164-176, 1995.
[44] C. Schmid and R. Mohr, “Combining Greyvalue Invariants with Local Constraints for Object Recognition,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 872-877, June 1996.
[45] S. Sclaroff and A. Pentland, “Modal Matching for Correspondence and Recognition,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 17, no. 6, pp. 545-561, June 1995.
[46] T.B. Sebastian, P.N. Klein, and B.B. Kimia, “Recognition of Shapes by Editing their Shock Graphs,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 26, no. 5, pp. 550-571, May 2004.
[47] J. Shi and J. Malik, “Normalized Cuts and Image Segmentation,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, June 1997.
[48] K. Siddiqi, A. Shokoufandeh, S. Dickinson, and S. Zucker, “Shock Graphs and Shape Matching,” Int'l J. Computer Vision, vol. 30, pp. 1-24, 1999.
[49] F. Solina and R. Bajcsy, “Recovery of Parametric Models from Range Images: The Case for Superquadrics with Global Deformations,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 12, no. 2, pp. 131-146, Feb. 1990.
[50] M. Turk and A. Pentland, “Eigenfaces for Recognition,” J. Cognitive Neuroscience, vol. 3, no. 1, pp. 71-86, 1991.
[51] J. Utans, “Learning in Compositional Hierarchies: Inducing the Structure of Objects from Data,” Advances in Neural Information Processing Systems, J.D. Cowan, G. Tesauro, and J. Alspector, eds., vol. 6, pp. 285-292, Morgan Kaufmann, 1994.
[52] S. Wachsmuth, S. Stevenson, and S. Dickinson, “Towards a Framework for Learning Structured Shape Models from Text-Annotated Images,” Proc. HTL-NAACL03 Workshop Learning Word Meaning from Non-Lingustic Data, May 2003.
[53] M. Weber, M. Welling, and P. Perona, “Unsupervised Learning of Models for Recognition,” Proc. Sixth European Conf. Computer Vision, vol. 1, pp. 18-32, 2000.
[54] P.H. Winston, “Learning Structural Descriptions from Examples,” The Psychology of Computer Vision, chapter 5, pp. 157-209, McGraw-Hill, 1975.
[55] Y. Xu, E. Saber, and A. Tekalp, “Dynamic Learning from Multiple Examples for Semantic Object Segmentation and Search,” Computer Vision and Image Understanding, vol. 95, pp. 334-353, 2004.
[56] S. Zhu and A.L. Yuille, “Forms: A Flexible Object Recognition and Modelling System,” Int'l J. Computer Vision, vol. 20, no. 3, pp. 187-212, 1996.

Index Terms:
Index Terms- Image abstraction, automatic model acquisition, learning from examples, shape description, object recognition, graph algorithms.
Citation:
Yakov Keselman, Sven Dickinson, "Generic Model Abstraction from Examples," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 27, no. 7, pp. 1141-1156, July 2005, doi:10.1109/TPAMI.2005.139
Usage of this product signifies your acceptance of the Terms of Use.