The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.05 - May (2008 vol.30)
pp: 781-795
ABSTRACT
The high potential of Superquadrics as modeling elements for image segmentation tasks has been pointed out since years in the computer vision community. In this work we employ superquadrics as modeling elements for multiple object segmentation in range images. Segmentation is executed in two stages. Firstly, a hypothesis about the values of the segmentation parameters is generated. Secondly, the hypothesis is refined locally. In both stages, object boundary and region information are considered. Boundary information is derived via model-based edge detection in the input range image. Hypothesis generation uses boundary information to isolate image regions which can be accurately described by superquadrics. Within hypothesis refinement, a game-theoretic framework is used to fuse the two information sources by associating an objective function to each information source. Iterative optimization of the two objective functions in succession, outputs a precise description of all image objects. We demonstrate experimentally that this approach substantially improves the most established method in superquadric segmentation, in terms of accuracy and computational efficiency. We demonstrate the applicability of our segmentation framework in real world applications by constructing a novel robotic system for automatic unloading of jumbled box-like objects from platforms.
INDEX TERMS
range data, shape, size and shape, region growing, partitioning, edge and feature detection, surface fitting, applications
CITATION
Dimitrios Katsoulas, Christian Cea Bastidas, Dimitrios Kosmopoulos, "Superquadric Segmentation in Range Images via Fusion of Region and Boundary Information", IEEE Transactions on Pattern Analysis & Machine Intelligence, vol.30, no. 5, pp. 781-795, May 2008, doi:10.1109/TPAMI.2007.70736
REFERENCES
[1] H. Tek and B. Kimia, “Image Segmentation by Reaction-Diffusion Bubbles,” Proc. IEEE Int'l Conf. Computer Vision, pp. 156-162, 1995.
[2] S. Zhu and A. Yuille, “Region Competition: Unifying Snakes, Region Growing, and Bayes/MDL for Multiband Image Segmentation,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 18, no. 9, pp. 884-900, Sept. 1996.
[3] S. Sclaroff and L. Liu, “Deformable Shape Detection and Description via Model-Based Region Grouping,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 23, no. 5, pp. 475-489, May 2001.
[4] N. Paragios and R. Deriche, “Coupled Geodesic Active Regions for Image Segmentation: A Level Set Approach,” Proc. European Conf. Computer Vision, vol. 2, pp. 224-240, 2002.
[5] R. Nevatia and T. Binford, “Description and Recognition of Curved Objects,” Artificial Intelligence, vol. 8, no. 1, pp. 77-98, 1977.
[6] D. Keren, D. Cooper, and J. Subrahmonia, “Describing Complicated Objects by Implicit Polynomials,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 16, no. 1, pp. 38-53, Jan. 1994.
[7] I. Biederman, “Human Image Understanding: Recent Research and a Theory,” Computer Vision Graphics and Image Processing, vol. 32, pp. 29-73, 1985.
[8] K. Wu and M. Levine, “3-D Shape Approximation Using Parametric Geons,” Image Vision Computing, vol. 15, no. 2, pp.143-158, 1997.
[9] L. Staib and J. Duncan, “Model Based Deformable Surface Finding for Medical Images,” IEEE Trans. Medical Imaging, vol. 15, no. 5, pp. 720-731, 1996.
[10] L. Staib and J. Duncan, “Boundary Finding with Parametrically Deformable Models,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 14, no. 11, pp. 1061-1075, Nov. 1992.
[11] D. Terzopoulos, A. Witkin, and M. Kass, “Symmetry-Seeking Models and 3D Object Reconstruction,” Proc. IEEE Int'l Conf. Computer Vision, pp. 269-276, 1987.
[12] S. Muraki, “Volumetric Shape Description of Range Data Using Blobby Model,” Proc. Int'l Conf. Computer Graphics and Interactive Techniques (SIGGRAPH '91), Computer Graphics, vol. 25, no. 4, pp.227-235, July 1991.
[13] J. Hanson, “Hyperquadrics: Smoothly Deformable Shapes with Convex Polyhedral Bounds,” Computer Vision, Graphics, and Image Processing, vol. 44, pp. 191-210, 1988.
[14] A. Barr, “Superquadrics and Angle Preserving Transformations,” IEEE Computer Graphics and Applications, vol. 1, no. 1, pp. 11-23, 1981.
[15] F. Solina and R. Bajcsy, “Recovery of Parametric Models from Range Images: The Case for Superquadrics with Global Deformations,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 12, no. 2, pp. 131-147, Feb. 1990.
[16] A. Leonardis, A. Jaklic, and F. Solina, “Superquadrics for Segmenting and Modeling Range Data,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 19, no. 11, pp. 1289-1295, Nov. 1997.
[17] A. Jaklič, A. Leonardis, and F. Solina, “Segmentation and Recovery of Superquadrics,” Computational Imaging and Vision, vol. 20, 2000.
[18] F. Ferrie, J. Lagarde, and P. Whaite, “Darboux Frames, Snakes, and Super-Quadrics: Geometry from the Bottom Up,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 15, no. 8, pp. 771-784, Aug. 1993.
[19] D. Metaxas and S. Dickinson, “Integration of Quantitative and Qualitative Techniques for Deformable Model Fitting from Orthographic, Perspective, and Stereo Projections,” Proc. IEEE Int'l Conf. Computer Vision, pp. 641-649, 1993.
[20] D. Terzopoulos and D. Metaxas, “Dynamic 3D Models with Local and Global Deformations: Deformable Superquadrics,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 13, no. 7, pp.703-714, July 1991.
[21] N. Raja and A. Jain, “Recognizing Geons from Superquadrics Fitted to Range Data,” Image and Vision Computing, vol. 10, no. 3, pp. 179-190, Apr. 1992.
[22] A. Pentland and S. Sclaroff, “Closed-Form Solutions for Physically Based Shape Modeling and Recognition,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 13, no. 7, pp. 715-729, July 1991.
[23] A. Gupta, G. Lea, and K. Wohn, “Segmentation, Modeling and Classification of the Compact Objects in a Pile,” Proc. SPIE Symp. Intelligent Robot and Computer Vision VIII: Algorithms and Techniques, pp. 98-108, Nov. 1989.
[24] A. Gupta and R. Bajcsy, “Volumetric Segmentation of Range Images of 3D Objects Using Superquadric Models,” Computer Vision Graphics and Image Processing: Image Understanding, vol. 58, no. 3, pp. 302-326, 1993.
[25] L. Chevalier, F. Jaillet, and A. Baskurt, “Segmentation and Superquadric Modeling of 3D Objects,” Proc. Int'l Conf. Central Europe Computer Graphics, Visualization, and Computer Vision, 2003.
[26] S.J. Dickinson, D.N. Metaxas, and A. Pentland, “The Role of Model-Based Segmentation in the Recovery of Volumetric Parts from Range Data,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 19, no. 3, pp. 259-267, Mar. 1997.
[27] D. DeCarlo and D. Metaxas, “Shape Evolution with Structural and Topological Changes Using Blending,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 20, no. 11, pp. 1186-1205, Nov. 1998.
[28] T. Horikoshi and S. Suzuki, “3D Parts Decomposition from Sparse Range Data Using Information Criterion,” Proc. IEEE CS Conf. Computer Vision and Pattern Recognition, pp. 168-173, 1993.
[29] H. Zha, T. Hoshide, and T. Hasegawa, “A Recursive Fitting-and-Splitting Algorithm for 3-D Object Modeling Using Superquadrics,” Proc. IEEE Int'l Conf. Pattern Recognition, pp. 658-662, 1998.
[30] A. Pentland, “Automatic Extraction of Deformable Part Models,” Int'l J. Computer Vision, vol. 4, no. 2, pp. 107-126, 1990.
[31] R. Duda, P. Hart, and D. Stork, Pattern Classification, second ed. Wiley Interscience, 2001.
[32] J. Schoukens and R. Pintelon, Identification of Linear Systems. A Practical Guideline to Accurate Modeling. Pergamon Press, 1991.
[33] A. Leonardis, A. Gupta, and R. Bajcsy, “Segmentation of Range Images as the Search for Geometric Parametric Models,” Int'l J. Computer Vision, vol. 14, no. 3, pp. 253-277, Apr. 1995.
[34] C. Cea, “Superquadric Recovery in Range Images via Region Growing Influenced by Boundary Information,” master's thesis, Computer Science Dept., Inst. for Pattern Recognition and Image Processing, Univ. of Freiburg, 2004.
[35] M. Pilu and R. Fisher, “Equal-Distance Sampling of Superellipse Models,” Proc. 1995 British Conf. Machine Vision, vol. 1, pp. 257-266, 1995.
[36] P. Besl and R. Jain, “Segmentation through Variable-Order Surface Fitting,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 9, no. 2, pp. 167-192, 1988.
[37] D. Katsoulas, “Robust Recovery of Piled Box-Like Objects in Range Images,” PhD dissertation, Dept. of Computer Science, Inst. for Pattern Recognition and Image Processing, Univ. of Freiburg, 2004.
[38] J. Freixenet, X. Muñoz, J. Martí, and X. Lladó, “Colour Texture Segmentation by Region-Boundary Cooperation,” Proc. European Conf. Computer Vision, vol. 2, pp. 250-261, Sept. 2004.
[39] S. Li and T. Basar, “Distributed Algorithms for the Computation of Non-Cooperative Equilibria,” Automatica, vol. 23, no. 4, pp. 523-533, 1987.
[40] A. Chackraborty and J. Duncan, “Game Theoretic Integration for Image Segmentation,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 21, no. 1, pp. 12-30, Jan. 1999.
[41] A. Chakraborty, “Feature and Module Integration for Image Segmentation,” PhD dissertation, Yale Univ., 1996.
[42] X. Jiang and H. Bunke, “Edge Detection in Range Images Based on Scan Line Approximation,” Computer Vision and Image Understanding, vol. 73, no. 2, pp. 183-199, Feb. 1999.
[43] R. Duda and P. Hart, Pattern Recognition and Scene Analysis. John Wiley & Sons, 1973.
[44] D. Katsoulas and A. Werber, “Edge Detection in Range Images of Piled Box-Like Objects,” Proc. 17th Int'l Conf. Pattern Recognition, vol. 2, pp. 80-84, 2004.
[45] X. Muñoz, “Image Segmentation Integrating Colour, Texture and Boundary Information,” PhD dissertation, Univ. of Girona, 2003.
[46] J. Benois and D. Barba, “Image Segmentation by Region-Contour Cooperation for Image Coding,” Proc. Int'l Conf. Pattern Recognition, vol. C, pp. 331-334, 1992.
[47] D. Sinclair, “Voronoi Seeded Colour Image Segmentation,” Technical Report TR99-04, AT&T Laboratories, Cambridge, May 1999.
[48] T. Shimbashi, Y. Kokubo, and N. Shirota, “Region Segmentation Using Edge Based Circle Growing,” Proc. IEEE Int'l Conf. Image Processing, vol. C, pp. 65-68, 1995.
[49] X. Jiang, “An Adaptive Contour Closure Algorithm and Its Experimental Evaluation,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 22, no. 11, pp. 1252-1265, Nov. 2000.
[50] A. Chakraborty, L.H. Staib, and J.S. Duncan, “Deformable Boundary Finding Influenced by Region Homogeneity,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 624-627, June 1994.
[51] H. Bozma and J. Duncan, “A Game-Theoretic Approach to Integration of Modules,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 16, pp. 1074-1086, 1994.
[52] C. Ye and J. Borenstein, “Characterization of a 2-D Laser Scanner for Mobile Robot Obstacle Navigation,” Proc. IEEE Int'l Conf. Robotics and Automation, pp. 2512-2518, May 2002.
[53] D. Skocaj and A. Leonardis, “Range Image Acquisition of Objects with Non-Uniform Albedo Using Structured Light Range Sensor,” Proc. Int'l Conf. Pattern Recognition, pp. 1778-1781, 2000.
[54] D. Katsoulas and D.I. Kosmopoulos, “Box-Like Superquadric Recovery in Range Images by Fusing Region and Boundary Information,” Proc. IEEE Int'l Conf. Pattern Recognition, pp. 719-722, 2006.
[55] D. Katsoulas, “Reliable Recovery of Piled Box-Like Objects via Parabolically Deformable Superquadrics,” Proc. IEEE Int'l Conf. Computer Vision, pp. 931-938, 2003.
21 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool