This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Range Image Segmentation by an Effective Jump-Diffusion Method
September 2004 (vol. 26 no. 9)
pp. 1138-1153
This paper presents an effective jump-diffusion method for segmenting a range image and its associated reflectance image in the Bayesian framework. The algorithm works on complex real-world scenes (indoor and outdoor), which consist of an unknown number of objects (or surfaces) of various sizes and types, such as planes, conics, smooth surfaces, and cluttered objects (like trees and bushes). Formulated in the Bayesian framework, the posterior probability is distributed over a solution space with a countable number of subspaces of varying dimensions. The algorithm simulates Markov chains with both reversible jumps and stochastic diffusions to traverse the solution space. The reversible jumps realize the moves between subspaces of different dimensions, such as switching surface models and changing the number of objects. The stochastic Langevin equation realizes diffusions within each subspace. To achieve effective computation, the algorithm precomputes some importance proposal probabilities over multiple scales through Hough transforms, edge detection, and data clustering. The latter are used by the Markov chains for fast mixing. The algorithm is tested on 100 1D simulated data sets for performance analysis on both accuracy and speed. Then, the algorithm is applied to three data sets of range images under the same parameter setting. The results are satisfactory in comparison with manual segmentations.

[1] H. Akaike, A Bayesian Analysis of the Minimum AIC Procedure Annals of the Inst. Statistical Math., vol. 30A, pp. 9-14, 1978.
[2] F. Arman, B. Sabata, and J.K. Aggarwal, Segmentation of 3D Range Images Using Pyramidal Data Structures Proc. CVGIP: Image Understanding, vol. 57, no. 3, pp. 373-387, 1993.
[3] D.H. Ballard, Generalized Hough Transform to Detect Arbitrary Shapes Pattern Recognition, vol. 13, no. 2, pp. 111-122, 1981.
[4] A. Barbu and S.C. Zhu, Graph Partition by Swendsen-Wang Cuts Proc. Int'l Conf. Computer Vision, 2003.
[5] P.J. Besl and R.C. Jain,“Segmentation through variable-order surface fitting,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 10, no. 2, pp. 167-191, Mar. 1988.
[6] M.J. Black and A. Rangarajan, On the Unification of Line Process, Outlier Rejection, and Robust Statistics with Applications in Early Vision Int'l J. Computer Vision, vol. 19, no. 1, pp. 57-91, Jan. 1996.
[7] K. Bubna, Model Selection Techniques and Merging Rules for Range Data Segmentation Algorithms Computer Vision and Image Understanding, vol. 80, pp. 215-245, 2000.
[8] Y. Cheng, Mean Shift, Mode Seeking, and Clustering IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 17, no. 8, pp. 790-799, Aug. 1995.
[9] D. Comaniciu and P. Meer, Mean Shift Analysis and Applications Proc. IEEE Seventh Int'l Conf. Computer Vision, vol. 2, pp. 1197-1203, Sept. 1999.
[10] I.J. Cox, J.M. Rehg, and S. Hingorani, A Bayesian Multiple-Hypothesis Approach to Edge Grouping and Contour Segmentation Int'l J. Computer Vision, vol. 11, no. 1, pp. 5-24, 1993.
[11] F. Dell'Acqua and R. Fisher, Reconstruction of Planar Surfaces Behind Occlusions in Range Images IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 24, no. 4, pp. 569-575, Apr. 2002.
[12] P.J. Flynn and A.K. Jain, Surface classification: Hypothesis Testing and Parameter Estimation Proc. Computer Vision and Pattern Recognition, 1988.
[13] S. Geman and D. Geman, Stochastic Relaxation, Gibbs Distributions, and Bayesian Restoration of Images IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 6, pp. 721-741, 1984.
[14] S. Geman and C.R. Huang, Diffusion for Global Optimization SIAM J. Control and Optimization, vol. 24, no. 5, pp. 1031-1043, 1986.
[15] P.J. Green, Reversible Jump Markov Chain Monte Carlo Computation and Bayesian Model Determination Biometrika, vol. 82, pp. 711-732, 1995.
[16] T.J. Green and J.H. Shapiro, Maximum-Likelihood Laser Radar Rane Profiling with the Expectation-Maximization Algorithm Optical Eng., vol. 31, pp. 2343-2354, 1992.
[17] T.J. Green and J.H. Shapiro, Detecting Objects in 3D Laser Radar Ranege Images Optical Eng., vol. 33, pp. 865-873, 1994.
[18] U. Grenander and M.I. Miller, Representationsof Knowledge in Complex Systems J. Royal Statistical Soc. Series B, vol. 56, no. 4, 1994.
[19] A. Gupta, A. Leonardis, and R. Bajcsy, Segmentation of Range Images as the Search for Geometric Parametric Models Int'l J. Computer Vision, vol. 14, no. 3, pp. 253-277, 1995.
[20] R.L. Hoffman and A.K. Jain, Segmentation and Classification of Range Images IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 9, no. 5, pp. 608-620, 1987.
[21] A. Hoover, G. Jean-Baptiste, X. Jiang, P.J. Flynn, H. Bunke, D. Goldgof, K. Bowyer, D. Eggert, A. Fitzgibbon, and R. Fisher, “An Experimental Comparison of Range Segmentation Algorithms,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol 18, no. 7, pp. 673-689, July 1996.
[22] J.G. Huang, A.B. Lee, and D.B. Mumford, Statistics of Range Images Proc. Computer Vision and Pattern Recognition, 2000.
[23] M. Kass, A. Witkin, and D. Terzopoulos, Snakes: Active Contour Models Int'l J. Computer Vision, vol. 1, no. 4, pp. 321-332, 1988.
[24] R. Krishnapuram and S. Gupta, Morphological Methods for Detection and Classification of Edges in Range Images Math. Imaging and Vision, vol. 2, pp. 351-375, 1992.
[25] Y.G. Leclerc and M.A. Fischler, An Optimization-Based Approach to the Interpretation of Single Line Drawings as 3D Wire Frame Int'l J. Computer Vision, vol. 9, no. 2, pp. 113-136, 1992.
[26] Q.M. Luo, Signal and Range Image Segmentation by Data Driven Markov Chain Monte Carlo master's thesis, Dept. of Computer and Information Science, The Ohio State Univ., 2001.
[27] R. Maciuca and S.C. Zhu, How do Heuristics Expedite Markov Chain Search? Proc. Int'l Workshop Statistical and Computational Theories of Vision, 2003.
[28] D. Marshall, G. Lukacs, and R. Martin, “Robust Segmentation of Primitives from Range Data in the Presence of Geometric Degeneracy,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 23, no. 3, pp. 304-314, Mar. 2001.
[29] N. Metropolis, A.W. Rosenbluth, M.N. Rosenbluth, A.H. Teller, and E. Teller, Equations of State Calculations by Fast Computing Machines J. Chemical Physics, vol. 21, pp. 1087-1092, 1953.
[30] M. Nitzberg, T. Shiota, and D. Mumford, Filtering, Segmentation and Depth Lecture Notes in Computer Science, vol. 662, 1993.
[31] D.B. Phillips and A.F.M. Smith, Bayesian Model Comparison via Jump Diffusion Markov Chain Monte Carlo in Practice, W.R. Gilks, S.T. Richardson and D.J. Spiegelhalter, eds., chapter 13, Chapman and Hall, 1995.
[32] M.W. Powell, K.W. Bowyer, X. Jiang, and H. Bunke, Comparing Curved-Surface Range Image Segmentation Proc. Int'l Conf. Computer Vision, pp. 286-291, 1998.
[33] I. Stamos and P.K. Allen, Geometry and Texture Recovery of Scenes of Large Scale Computer Vision and Image Understanding, vol. 88, no. 2, pp. 94-118, Nov. 2002.
[34] J. Rissanen, Stochastic Complexity in Statistical Inquiry. Singapore: World Scientific, 1989.
[35] L. Tierney, Markov Chains for Exploring Posterior Distributions Annal of Statistics, vol. 22, pp. 1701-28, 1994.
[36] Z.W. Tu and S.C. Zhu, Image Segmentation by Data-Driven Markov Chain Monte Carlo IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 24, no. 5, pp. 657-673, May 2002.
[37] M. Umasuthan and A.M. Wallace, Outlier Removal and Discontinuity Preserving Smoothing of Range Data IEE Proc. Vision and Image Signal Process, vol. 143, no. 3, 1996.
[38] Z.Y. Zhang, Parameter Estimation Techniques: A Tutorial with Application to Conic Fitting technical report, INRIA, Sofia, France, 1995.
[39] S.C. Zhu and A. Yuille, “Region Competition: Unifying Snakes, Region Growing and Bayes/MDL for Multiband Image Segmentation,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 18, pp. 884-900, 1996.

Index Terms:
Energy minimization, jump-diffusion, range segmentation, Markov chain Monte Carlo, data clustering, edge detection, Hough transform, change point detection.
Citation:
Feng Han, Zhuowen Tu, Song-Chun Zhu, "Range Image Segmentation by an Effective Jump-Diffusion Method," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 26, no. 9, pp. 1138-1153, Sept. 2004, doi:10.1109/TPAMI.2004.70
Usage of this product signifies your acceptance of the Terms of Use.