The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.07 - July (2013 vol.35)
pp: 1649-1659
A. Barbu , Dept. of Stat., Florida State Univ., Tallahassee, FL, USA
ABSTRACT
Object parsing and segmentation from point clouds are challenging tasks because the relevant data is available only as thin structures along object boundaries or other features, and is corrupted by large amounts of noise. To handle this kind of data, flexible shape models are desired that can accurately follow the object boundaries. Popular models such as active shape and active appearance models (AAMs) lack the necessary flexibility for this task, while recent approaches such as the recursive compositional models make model simplifications to obtain computational guarantees. This paper investigates a hierarchical Bayesian model of shape and appearance in a generative setting. The input data is explained by an object parsing layer which is a deformation of a hidden principal component analysis (PCA) shape model with Gaussian prior. The paper also introduces a novel efficient inference algorithm that uses informed data-driven proposals to initialize local searches for the hidden variables. Applied to the problem of object parsing from structured point clouds such as edge detection images, the proposed approach obtains state-of-the-art parsing errors on two standard datasets without using any intensity information.
INDEX TERMS
Shape, Principal component analysis, Computational modeling, Inference algorithms, Deformable models, Data models, Image edge detection,active shape model, Object parsing, hierarchical models, markov random field optimization
CITATION
A. Barbu, "Hierarchical Object Parsing from Structured Noisy Point Clouds", IEEE Transactions on Pattern Analysis & Machine Intelligence, vol.35, no. 7, pp. 1649-1659, July 2013, doi:10.1109/TPAMI.2012.262
REFERENCES
[1] Y. Amit, U. Grenander, and M. Piccioni, "Structural Image Restoration through Deformable Templates," J. Am. Statistical Assoc., vol. 86, pp. 376-387, 1991.
[2] X. Bai, X. Wang, L. Latecki, W. Liu, and Z. Tu, "Active Skeleton for Non-Rigid Object Detection," Proc. 12th IEEE Int'l Conf. Computer Vision, pp. 575-582, 2009.
[3] A. Barbu, "Training an Active Random Field for Real-Time Image Denoising," IEEE Trans. Image Processing, vol. 18., no. 11, pp. 2451-2462, Nov. 2009.
[4] G. Behiels, D. Vandermeulen, F. Maes, P. Suetens, and P. Dewaele, "Active Shape Model-Based Segmentation of Digital X-Ray Images," Proc. Second Int'l Conf. Medical Image Computing and Computer-Assisted Intervention, pp. 128-137, 1999.
[5] A. Besbes, N. Komodakis, G. Langs, and N. Paragios, "Shape Priors and Discrete Mrfs for Knowledge-Based Segmentation," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 1295-1302, 2009.
[6] E. Borenstein and S. Ullman, "Class-Specific, Top-Down Segmentation," Proc. Seventh European Conf. Computer Vision, pp. 639-641, 2002.
[7] E. Borenstein and S. Ullman, "Combined Top-Down/Bottom-Up Segmentation," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 30., no. 12, pp. 2109-2125, Dec. 2008.
[8] Y. Boykov, O. Veksler, and R. Zabih, "Fast Approximate Energy Minimization via Graph Cuts," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 23, no. 11, pp. 1222-1239, Nov. 2001.
[9] H. Chui and A. Rangarajan, "A New Point Matching Algorithm for Non-Rigid Registration," Computer Vision and Image Understanding, vol. 89, no. 2, p. 141, 2003.
[10] T. Cootes, G. Edwards, and C. Taylor, "Active Appearance Models," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 23, no. 6, pp. 681-685, June 2001.
[11] T. Cootes et al., "Active Shape Models—Their Training and Application," Computer Vision and Image Understanding, vol. 61, no. 1, pp. 38-59, 1995.
[12] T. Cour and J. Shi, "Recognizing Objects by Piecing Together the Segmentation Puzzle," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2007.
[13] D. Cristinacce and T. Cootes, "Automatic Feature Localisation with Constrained Local Models," Pattern Recognition, vol. 41, no. 10, pp. 3054-3067, 2008.
[14] A. Falcão, J. Udupa, S. Samarasekera, S. Sharma, B. Hirsch, and R. Lotufo, "User-Steered Image Segmentation Paradigms: Live Wire and Live Lane," Graphical Models and Image Processing, vol. 60, no. 4, pp. 233-260, 1998.
[15] P. Felzenszwalb and J. Schwartz, "Hierarchical Matching of Deformable Shapes," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2007.
[16] L. Fernandes and M. Oliveira, "Real-Time Line Detection through an Improved Hough Transform Voting Scheme," Pattern Recognition, vol. 41, no. 1, pp. 299-314, 2008.
[17] V. Ferrari, L. Fevrier, F. Jurie, and C. Schmid, "Groups of Adjacent Contour Segments for Object Detection," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 30, no. 1, pp. 36-51, Jan. 2007.
[18] V. Ferrari, F. Jurie, and C. Schmid, "From Images to Shape Models for Object Detection," Int'l J. Computer Vision, vol. 87, no. 3, pp. 284-303, 2010.
[19] D. Freedman and T. Zhang, "Interactive Graph Cut Based Segmentation with Shape Priors," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 755-762, 2005.
[20] V. Jojic, S. Gould, and D. Koller, "Accelerated Dual Decomposition for Map Inference," Proc. Int'l Conf. Machine Learning, 2010.
[21] P. Kohli, L. Ladicky, and P. Torr, "Robust Higher Order Potentials for Enforcing Label Consistency," Int'l J. Computer Vision, vol. 82, no. 3, pp. 302-324, 2009.
[22] N. Komodakis and N. Paragios, "Beyond Pairwise Energies: Efficient Optimization for Higher-Order Mrfs," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 2985-2992, 2009.
[23] M. Kumar, P. Torr, and A. Zisserman, "Obj Cut," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 18-25, 2005.
[24] B. Leibe, A. Leonardis, and B. Schiele, "Combined Object Categorization and Segmentation with an Implicit Shape Model," Proc. Workshop Statistical Learning in Computer Vision, European Conf. Computer Vision, pp. 17-32, 2004.
[25] A. Levin and Y. Weiss, "Learning to Combine Bottom-Up and Top-Down Segmentation," Int'l J. Computer Vision, vol. 81, pp. 105-118, 2009.
[26] H. Li, S. Yan, and L. Peng, "Robust Non-Frontal Face Alignment with Edge Based Texture," J. Computer Science and Technology, vol. 20, no. 6, pp. 849-854, 2005.
[27] Y. Li, L. Gu, and T. Kanade, "A Robust Shape Model for Multi-View Car Alignment," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2009.
[28] Y. Li and D.P. Huttenlocher, "Learning for Optical Flow Using Stochastic Optimization," Proc. 10th European Conf. Computer Vision, 2008.
[29] J. Liu and J. Udupa, "Oriented Active Shape Models," IEEE Trans. Medical Imaging, vol. 28, no. 4, pp. 571-584, Apr. 2009.
[30] J. Malcolm, Y. Rathi, and A. Tannenbaum, "Graph Cut Segmentation with Nonlinear Shape Priors," Proc. IEEE Int'l Conf. Image Processing, pp. IV-365-IV-368, 2007.
[31] A. Rangarajan, H. Chui, and F. Bookstein, "The Softassign Procrustes Matching Algorithm," Proc. Information Processing in Medical Imaging, pp. 29-42, 1997.
[32] X. Ren, C. Fowlkes, and J. Malik, "Cue Integration for Figure/Ground Labeling," Advances in Neural Information Processing Systems, vol. 18, p. 1121, 2006.
[33] M. Rogers and J. Graham, "Robust Active Shape Model Search," Proc. European Conf. Computer Vision, pp. 289-312, 2006.
[34] D. Scharstein and C. Pal, "Learning Conditional Random Fields for Stereo," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 1-8, 2007.
[35] J. Shotton, A. Blake, and R. Cipolla, "Multi-Scale Categorical Object Recognition Using Contour Fragments," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 30, no. 7, pp. 1270-1281, July 2008.
[36] M. Sofka, J. Zhang, S. Zhou, and D. Comaniciu, "Multiple Object Detection by Sequential Monte Carlo and Hierarchical Detection Network," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 1735-1742, 2010.
[37] M. Stark, M. Goesele, and B. Schiele, "A Shape-Based Object Class Model for Knowledge Transfer," Proc. 12th IEEE Int'l Conf. Computer Vision, pp. 373-380, 2010.
[38] M.B. Stegmann, "Active Appearance Models: Theory, Extensions and Cases," Aug. 2000.
[39] M.B. Stegmann, "Analysis and Segmentation of Face Images Using Point Annotations and Linear Subspace Techniques," technical report, Informatics and Math. Modelling, Technical Univ. of Denmark, 2002.
[40] M.B. Stegmann, B.K. Ersbøll, and R. Larsen, "FAME—A Flexible Appearance Modelling Environment," IEEE Trans. Medical Imaging, vol. 22., no. 10, pp. 1319-1331, Oct. 2003.
[41] L. Torresani, A. Hertzmann, and C. Bregler, "Learning Non-Rigid 3D Shape from 2D Motion," Proc. Conf. Neural Information Processing Systems, 2003.
[42] P. Tresadern, H. Bhaskar, S. Adeshina, C. Taylor, and T. Cootes, "Combining Local and Global Shape Models for Deformable Object Matching," Proc. British Machine Vision Conference, 2009.
[43] J. Winn and N. Jojic, "Locus: Learning Object Classes with Unsupervised Segmentation," Proc. 10th IEEE Int'l Conf. Computer Vision, 2005.
[44] Y. Wu, Z. Si, H. Gong, and S.C. Zhu, "Learning Active Basis Model for Object Detection and Recognition," Int'l J. Computer Vision, vol. 90, pp. 1-38, 2009.
[45] X. Yang, T. Wu, and S.C. Zhu, "Evaluating Information Contributions of Bottom-Up and Top-Down Processes," Proc. 12th IEEE Int'l Conf. Computer Vision, pp. 1042-1049, 2010.
[46] L. Zhu, Y. Chen, and A. Yuille, "Learning a Hierarchical Deformable Template for Rapid Deformable Object Parsing," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 32, no. 6, pp. 1029-1043, June 2009.
[47] Q. Zhu, G. Song, and J. Shi, "Untangling Cycles for Contour Grouping," Proc. 11th IEEE Int'l Conf. Computer Vision, pp. 1-8, 2007.
31 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool