The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.10 - Oct. (2012 vol.34)
pp: 1966-1977
Amir Alush , Bar-Ilan University, Ramt-Gan
Jacob Goldberger , Bar-Ilan University , Ramt-Gan
ABSTRACT
We present a method for combining several segmentations of an image into a single one that in some sense is the average segmentation in order to achieve a more reliable and accurate segmentation result. The goal is to find a point in the “space of segmentations” which is close to all the individual segmentations. We present an algorithm for segmentation averaging. The image is first oversegmented into superpixels. Next, each segmentation is projected onto the superpixel map. An instance of the EM algorithm combined with integer linear programming is applied on the set of binary merging decisions of neighboring superpixels to obtain the average segmentation. Apart from segmentation averaging, the algorithm also reports the reliability of each segmentation. The performance of the proposed algorithm is demonstrated on manually annotated images from the Berkeley segmentation data set and on the results of automatic segmentation algorithms.
INDEX TERMS
Image segmentation, Clustering algorithms, Reliability, Correlation, Human factors, Optimization, Approximation algorithms, EM algorithm., Image segmentation, ensemble segmentation, integer linear programming, correlation clustering
CITATION
Amir Alush, Jacob Goldberger, "Ensemble Segmentation Using Efficient Integer Linear Programming", IEEE Transactions on Pattern Analysis & Machine Intelligence, vol.34, no. 10, pp. 1966-1977, Oct. 2012, doi:10.1109/TPAMI.2011.280
REFERENCES
[1] P. Arbelaez, M. Maire, C. Fowlkes, and J. Malik, "From Contours to Regions: An Empirical Evaluation," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2009.
[2] N. Bansal, A. Blum, and S. Chawla, "Correlation Clustering," Machine Learning J., vol. 56, pp. 86-113, 2004.
[3] A. Ben-Dor, R. Shamir, and Z. Yakhini, "Clustering Gene Expression Patterns," J. Computational Biology, vol. 6, pp. 281-297, 1999.
[4] C.M. Christoudias, B. Georgescu, and P. Meer, "Synergism in Low Level Vision," Proc. Int'l Conf. Pattern Recognition, 2002.
[5] D. Comaniciu and P. Meer, "Mean Shift: A Robust Approach Toward Feature Space Analysis," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 24, no. 5, pp. 603-619, May 2002.
[6] T. Cour, F. Benezit, and J. Shi, "Spectral Segmentation with Multiscale Graph Decomposition," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2005.
[7] A. Dempster, N. Laird, and D. Rubin, "Maximum Likelihood Estimation from Incomplete Data via the EM Algorithm," J. Royal Statistical Soc. Series B, vol. 39, pp. 1-38, 1977.
[8] P. Donmez, J. Carbonell, and J. Schneider, "Efficiently Learning the Accuracy of Labeling Sources for Selective Sampling," Proc. 15th ACM SIGKDD Int'l Conf. Knowledge Discovery and Data Mining, 2009.
[9] M. Elsner and W. Schudy, "Bounding and Comparing Methods for Correlation Clustering Beyond ILP," Proc. Workshop Integer Linear Programming for Natural Language Processing, pp. 19-27, 2009.
[10] J. Freixenet, X. Munoz, D. Raba, J. Marti, and X. Cuff, "Yet Another Survey on Image Segmentation," Proc. European Conf. Computer Vision, 2002.
[11] J. Hopcrofta and R. Tarjan, "Efficient Algorithms for Graph Manipulation," Comm. ACM, vol. 16, pp. 372-378, 1973.
[12] M. Maire, P. Arbelaez, C. Fowlkes, and J. Malik, "Using Contours to Detect and Localize Junctions in Natural Images," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2008.
[13] T. Malisiewicz and A.A. Efros, "Improving Spatial Support for Objects via Multiple Segmentations," Proc. British Machine Vision Conf., 2007.
[14] D. Martin, C. Fowlkes, and J. Malik, "Learning to Detect Natural Image Boundaries Using Local Brightness, Color, and Texture Cues," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 26, no. 5, pp. 530-549, May 2004.
[15] D. Martin, C. Fowlkes, D. Tal, and J. Malik, "A Database of Human Segmented Natural Images and Its Application to Evaluating Segmentation Algorithms and Measuring Ecological Statistics," Proc. IEEE Int'l Conf. Computer Vision, 2001.
[16] M. Meila, "Comparing Clusterings: An Axiomatic View," Proc. 22nd Int'l Conf. Machine Learning, 2005.
[17] M. Mignotte, "A Label Field Fusion Bayesian Model and Its Penalized Maximum Rand Estimator for Image Segmentation," IEEE Trans. Image Processing, vol. 19, no. 6, pp. 1610-1624, June 2010.
[18] V. Ng and C. Cardie, "Improving Machine Learning Approaches to Coreference Resolution," Proc. Ann. Meeting Assoc. for Computational Linguistics, pp. 104-111, 2002.
[19] C. Pantofaru, C. Schmid, and M. Hebert, "Object Recognition by Integrating Multiple Image Segmentations," Proc. European Conf. Computer Vision, 2008.
[20] A. Rabinovich, T. Lange, J. Buhmann, and S. Belongie, "Model Order Selection and Cue Combination for Image Segmentation," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2006.
[21] W. Rand, "Objective Criteria for the Evaluation of Clustering Methods," J. Am. Statistical Assoc., vol. 66, no. 366, pp. 846-850, 1971.
[22] S. Rao, H. Mobahi, A. Yang, S. Sastry, and Y. Ma, "Natural Image Segmentation with Adaptive Texture and Boundary Encoding," Proc. Ninth Asian Conf. Computer Vision, 2009.
[23] V. Raykar, S. Yu, L. Zhao, A. Jerebko, C. Florin, G. Valadez, L. Bogoni, and L. Moy, "Supervised Learning from Multiple Experts: Whom to Trust When Everyone Lies a bit," Proc. Int'l Conf. Machine Learning, 2009.
[24] B.C. Russell, A.A. Efros, J. Sivic, W.T. Freeman, and A. Zisserman, "Using Multiple Segmentations to Discover Objects and Their Extent in Image Collections," Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2006.
[25] J. Shi and J. Malik, "Normalized Cuts and Image Segmentation," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 22, no. 8, pp. 888-905, Aug. 2000.
[26] V. Singh, L. Mukherjee, J. Peng, and J. Xu, "Ensemble Clustering Using Semidefinite Programming with Applications," J. Machine Learning, vol. 79, pp. 177-200, 2010.
[27] P. Smyth, U. Fayyad, M. Burl, P. Perona, and P. Baldi, "Inferring Ground Truth from Subjective Labelling of Venus Images," Advances in Neural Information Processing Systems, vol. 7, pp. 1085-1092, 1995.
[28] A. Sorokin and D. Forsyth, "Utility Data Annotation with Amazon Mechanical Turk," Proc. IEEE CS Conf. Computer Vision and Pattern Recognition, 2008.
[29] R. Unnikrishnan, C. Pantofaru, and M. Hebert, "Toward Objective Evaluation of Image Segmentation Algorithms," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 29, no. 6, pp. 929-944, June 2007.
[30] L. Vincent and P. Soille, "Watersheds in Digital Spaces: An Efficient Algorithm Based on Immersion Simulations," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 13, no. 6, pp. 583-598, June 1991.
[31] H. Wang and J. Oliensis, "Rigid Shape Matching by Segmentation Averaging," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 32, no. 4, pp. 619-635, Apr. 2010.
[32] S.K. Warfield, K.H. Zou, and W.M. Wells, "Simultaneous Truth and Performance Level Estimation (STAPLE): An Algorithm for the Validation of Image Segmentation," IEEE Trans. Medical Imaging, vol. 23, no.7, pp. 903-921, July 2004.
[33] P. Welinder, S. Branson, S. Belongie, and P. Perona, "The Multidimensional Wisdom of Crowds," Advances in Neural Information Processing Systems, vol. 23, pp. 2424-2432, 2010.
[34] J. Whitehill, P. Ruvolo, T. Wu, J. Bergsma, and J. Movellan, "Whose Vote Should Count More: Optimal Integration of Labels from Labelers of Unknown Expertise," Advances in Neural Information Processing Systems, vol. 22, pp. 2035-2043, 2009.
[35] A. Yang, J. Wright, Y. Ma, and S. Sastry, "Unsupervised Segmentation of Natural Images via Lossy Data Compression," J. Computer Vision and Image Understanding, vol. 110, no. 2, pp. 212-225, 2008.
8 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool