The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.01 - January (2009 vol.31)
pp: 142-157
Iasonas Kokkinos , Ecole Centrale Paris, France
Georgios Evangelopoulos , National Technical University of Athens, Athens
Petros Maragos , National Technical University of Athens, Athens
ABSTRACT
In this work we approach the analysis and segmentation of natural textured images by combining ideas from image analysis and probabilistic modeling. We rely on AM-FM texture models and specifically on the Dominant Component Analysis (DCA) paradigm for feature extraction. This method provides a low-dimensional, dense and smooth descriptor, capturing essential aspects of texture, namely scale, orientation, and contrast. Our contributions are at three levels of the texture analysis and segmentation problems: First, at the feature extraction stage we propose a Regularized Demodulation Algorithm that provides more robust texture features and explore the merits of modifying the channel selection criterion of DCA. Second, we propose a probabilistic interpretation of DCA and Gabor filtering in general, in terms of Local Generative Models. Extending this point of view to edge detection facilitates the estimation of posterior probabilities for the edge and texture classes. Third, we propose the Weighted Curve Evolution scheme that enhances the Region Competition/ Geodesic Active Regions methods by allowing for the locally adaptive fusion of heterogeneous cues. Our segmentation results are evaluated on the Berkeley Segmentation Benchmark, and compare favorably to current state-of-the-art methods.
INDEX TERMS
Image Processing and Computer Vision, Texture, Edge and feature detection, Segmentation, Image models, Statistical
CITATION
Iasonas Kokkinos, Georgios Evangelopoulos, Petros Maragos, "Texture Analysis and Segmentation Using Modulation Features, Generative Models, and Weighted Curve Evolution", IEEE Transactions on Pattern Analysis & Machine Intelligence, vol.31, no. 1, pp. 142-157, January 2009, doi:10.1109/TPAMI.2008.33
REFERENCES
[1] S. Belongie , C. Carson , H. Greenspan , and J. Malik , “Color- and Texture-Based Image Segmentation Using EM and Its Application to Content-Based Image Retrieval,” Proc. Sixth Int'l Conf. Computer Vision, 1998.
[2] A.C. Bovik , M. Clark , and W. Geisler , “Multichannel Texture Analysis Using Localized Spatial Filters,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 12, no. 1, pp. 55-73, Jan. 1990.
[3] A.C. Bovik , N. Gopal , T. Emmoth , and A. Restrepo , “Localized Measurement of Emergent Image Frequencies by Gabor Wavelets,” IEEE Trans. Information Theory, vol. 38, pp. 691-712, 1992.
[4] A.C. Bovik , P. Maragos , and T.F. Quatieri , “AM-FM Energy Detection and Separation in Noise Using Multiband Energy Operators,” IEEE Trans. Signal Processing, vol. 41, pp. 3245-3265, 1993.
[5] T. Brox and J. Weickert , “A TV Flow Based Local Scale Measure for Texture Discrimination,” Proc. Eighth European Conf. Computer Vision, 2004.
[6] V. Caselles , R. Kimmel , and G. Sapiro , “Geodesic Active Contours,” Int'l. J. Computer Vision, vol. 22, no. 1, pp. 61-79, 1997.
[7] T. Chan and L. Vese , “Active Contours without Edges,” IEEE Trans. Image Processing, vol. 10, no. 2, pp. 266-277, 2001.
[8] G.C. Cross and A.K. Jain , “Markov Random Field Texture Models,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 5, no. 1, pp. 25-39, Jan. 1983.
[9] J. Daugman , “Uncertainty Relation for Resolution in Space, Spatial Frequency, and Orientation Optimized by Two-Dimensional Visual Cortical Filters,” J. Optical Soc. of America (A), vol. 2, no. 7, pp. 160-169, 1985.
[10] D. Dimitriadis and P. Maragos , “Robust Energy Demodulation Based on Continuous Models with Application to Speech Recognition,” Proc. Eighth European Conf. Speech Comm. and Technology, 2003.
[11] G. Evangelopoulos , I. Kokkinos , and P. Maragos , “Advances in Variational Image Segmentation Using AM-FM Models: Regularized Demodulation and Probabilistic Cue Integration,” Proc. Third Int'l Workshop Variational and Level Set Methods, pp. 121-136, 2005.
[12] P. Felzenswalb and D. Huttenlocher , “Distance Transforms of Sampled Functions,” Technical Report TR2004-1963, Cornell CIS, 2004.
[13] C. Fowlkes and J. Malik , “How Much Does Globalization Help Segmentation?” Technical Report CSD-4-1340, Univ, of California Berkeley, 2004.
[14] D. Gabor , “Theory of Communication,” J. IEE, vol. 93, no. 3, pp.429-457, 1946.
[15] E. Gumbel , A. Greenwood , and D. Durand , “The Circular Normal Distribution: Theory and Tables,” J. Am. Statistical Assoc., vol. 48, no. 261, pp. 131-152, 1953.
[16] C.-E. Guo , S.-C. Zhu , and Y.N. Wu , “A Mathematical Theory of Primal Sketch and Sketchability,” Proc. Ninth Int'l Conf. Computer Vision, 2003.
[17] C.-E. Guo , S.-C. Zhu , and Y.N. Wu , “Modeling Visual Patterns by Integrating Descriptive and Generative Methods,” Int'l. J. Computer Vision, vol. 53, no. 1, pp. 5-29, 2003.
[18] J.P. Havlicek , A.C. Bovik , and D. Chen , “AM-FM Image Modeling and Gabor Analysis,” Visual Communication and Image Processing, Marcel Dekker, 1999.
[19] J.P. Havlicek , D.S. Harding , and A.C. Bovik , “The Multi-Component AM-FM Image Representation,” IEEE Trans. Image Processing, vol. 5, no. 6, pp. 1094-1100, 1996.
[20] J.P. Havlicek , D.S. Harding , and A.C. Bovik , “Multidimensional Quasi-Eigenfunction Approximations and Multicomponent AM-FM Models,” IEEE Trans. Image Processing, vol. 9, no. 2, pp. 227-242, 2000.
[21] R. Jacobs , “Methods for Combining Experts' Probability Assessments,” Neural Computation, no. 7, pp. 867-888, 1995.
[22] A.K. Jain and F. Farrokhnia , “Unsupervised Texture Segmentation Using Gabor Filters,” Pattern Recognition, vol. 24, no. 12, pp. 1167-1186, 1991.
[23] B. Julesz , “Textons, the Elements of Texture Perception and Their Interactions,” Nature, vol. 290, pp. 91-97, 1981.
[24] S.M. Kay , Fundamentals of Statistical Signal Processing: Estimation and Detection Theory, vols. 1-2. Prentice Hall, 1993.
[25] S. Kichenassamy , A. Kumar , P. Olver , A. Tannenbaum , and A. Yezzi , “Gradient Flows and Geometric Active Contour Models,” Proc. Fifth Int'l Conf. Computer Vision, 1995.
[26] H. Knutsson and C.F. Westin , “Normalized Convolution and Differential Convolution,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, 1993.
[27] I. Kokkinos , G. Evangelopoulos , and P. Maragos , “Advances in Texture Analysis: Energy Dominant Components and Multiple Hypothesis Testing,” Proc. Int'l Conf. Image Processing, 2004.
[28] I. Kokkinos , G. Evangelopoulos , and P. Maragos , “Modulation-Feature Based Textured Image Segmentation Using Curve Evolution,” Proc. Int'l Conf. Image Processing, 2004.
[29] I. Kokkinos and P. Maragos , “A Detection-Theoretic Approach to Texture and Edge Discrimination,” Proc. Fourth Int'l Workshop Texture Analysis and Synthesis, 2005.
[30] T.S. Lee , D. Mumford , and A. Yuille , “Texture Segmentation by Minimizing Vector Valued Energy Functionals,” Proc. Second European Conf. Computer Vision, 1992.
[31] J. Malik , S. Belongie , T. Leung , and J. Shi , “Contour and Texture Analysis for Image Segmentation,” Int'l. J. Computer Vision, vol. 43, no. 1, pp. 7-27, 2001.
[32] J. Malik and P. Perona , “Preattentive Texture Discrimination with Early Vision Mechanisms,” J. Optical Soc. of America (A), vol. 7, no. 5, pp. 923-932, 1990.
[33] D. Mallat and Z. Zhang , “Matching Pursuit in a Time-Frequency Dictionary,” IEEE Trans. Signal Processing, vol. 41, pp. 3397-3415, 1993.
[34] P. Maragos and A.C. Bovik , “Image Demodulation Using Multidimensional Energy Separation,” J. Optical Soc. of Am. (A), vol. 12, no. 9, pp. 1867-1876, 1995.
[35] P. Maragos , J.F. Kaiser , and T.F. Quatieri , “Energy Separation in Signal Modulations with Application to Speech Analysis,” IEEE Trans. Signal Processing, vol. 41, no. 10, pp. 3024-3051, Oct. 1993.
[36] D. Martin , “An Empirical Approach to Grouping and Segmentation,” PhD dissertation, Univ. of California Berkeley, 2002.
[37] D. Martin , C. Fowlkes , and J. Malik , “Learning to Detect Natural Image Boundaries Using Local Brightness, Color, and Texture Cues,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 26, no. 5, pp. 530-549, May 2004.
[38] D. Martin , C. Fowlkes , D. Tal , and J. Malik , “A Database of Human Segmented Natural Images and Its Application to Evaluating Segmentation Algorithms and Measuring Ecological Statistics,” Proc. Eighth Int'l Conf. Computer Vision, 2001.
[39] C. Morrone and D. Burr , “Feature Detection in Human Vision: A Phase-Dependent Energy Model,” Proc. Royal Soc. of London B, vol. 235, pp. 221-245, 1988.
[40] M. Morrone and R. Owens , “Feature Detection from Local Energy,” Pattern Recognition Letters, vol. 6, pp. 303-313, 1987.
[41] D. Mumford and J. Shah , “Optimal Approximations by Piecewise Smooth Functions and Associated Variational Problems,” Comm. Pure and Applied Math., vol. 42, no. 5, pp. 577-685, 1989.
[42] S. Osher and J. Sethian , “Fronts Propagating with Curvature-Dependent Speed: Algorithms Based on Hamilton-Jacobi Formulations,” J. Computational Physics, vol. 79, pp. 12-49, 1988.
[43] G. Papandreou and P. Maragos , “Multigrid Geometric Active Contour Models,” IEEE Trans. Image Processing, vol. 16, no. 1, pp.229-240, 2007.
[44] N. Paragios and R. Deriche , “Geodesic Active Regions and Level Set Methods for Supervised Texture Segmentation,” Int'l. J. Computer Vision, vol. 46, no. 3, pp. 223-247, 2002.
[45] P. Perona and J. Malik , “Detecting and Localizing Edges Composed of Steps, Peaks and Roofs,” Proc. Third Int'l Conf. Computer Vision, 1990.
[46] T.A. Poggio , H. Voorhees , and A. Yuille , “A Regularized Solution to Edge Detection,” J. Complexity, vol. 4, no. 2, pp. 106-128, Oct. 1988.
[47] J. Portilla and E. Simoncelli , “A Parametric Texture Model Based on Joint Statistics of Complex Wavelet Coefficients,” Int'l J. Computer Vision, vol. 40, no. 1, pp. 49-71, 2000.
[48] N. Ray , J. Havlicek , S. Acton , and M. Pattichis , “Active Contour Segmentation Guided by AM-FM DCA,” Proc. Int'l Conf. Image Processing, 2001.
[49] M. Rousson , T. Brox , and R. Deriche , “Active Unsupervised Texture Segmentation on a Diffusion Based Space,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2003.
[50] J. Shi and J. Malik , “Normalized Cuts and Image Segmentation,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 22, no. 8, pp. 888-905, Aug. 2001.
[51] T. Tangsukson and J.P. Havlicek , “AM-FM Image Segmentation,” Proc. Int'l Conf. Image Processing, 2000.
[52] Z.W. Tu and S.C. Zhu , “Image Segmentation by Data-Driven MCMC,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 24, no. 5, pp. 657-673, May 2002.
[53] L. Vese and S.J. Osher , “Modeling Textures with Total Variation Minimization and Oscillating Patterns in Image Processing,” J.Scientific Computing, vol. 19, nos. 1-3, pp. 553-572, 2003.
[54] C.F. Westin , K. Nordberg , and H. Knutsson , “On the Equivalence of Normalized Convolution and Normalized Differential Convolution,” Proc. IEEE Conf. Computer Vision and Pattern Recognition, 1994.
[55] A. Yezzi , A. Tsai , and A. Willsky , “A Statistical Approach to Snakes for Bimodal and Trimodal Imagery,” Proc. Seventh Int'l Conf. Computer Vision, 1999.
[56] S.C. Zhu , Y. Wu , and D. Mumford , “Filters, Random Fields and Maximum Entropy (FRAME): Towards a Unified Theory for Texture Modeling,” Int'l. J. Computer Vision, vol. 27, no. 2, pp. 107-126, 1998.
[57] S.C. Zhu and A. Yuille , “Region Competition: Unifying Snakes, Region Growing and Bayes/MDL for Multiband Image Segmentation,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 18, no. 9, pp. 884-900, Sept. 1996.
5 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool