This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
Mode Detection by Relaxation
November 1988 (vol. 10 no. 6)
pp. 970-978

A relaxation process is described and applied to the detection of the modes of the underlying probability density function for clustering multidimensional data. When the process is iterated, the label probabilities become very high in the modal region and very low in the valleys, so that mode detection becomes trivial.

[1] I. Gitman and M. D. Levine, "An algorithm for detecting unimodal fuzzy sets and its application as a clustering technique,"IEEE Trans. Comput., vol. C-19, pp. 583-593, July 1970.
[2] I. Gitman, "An algorithm for nonsupervised pattern classification,"IEEE Trans. Syst., Man., Cybern., vol. SMC-3, pp. 66-74, 1973.
[3] R. Mizoguchi and M. Shimura, "Nonparametric learning without a teacher based on mode estimation,"IEEE Trans. Comput., vol. C-25, no. 11, pp. 1109-1117, 1976.
[4] C. P. Vasseur and J. G. Postaire, "A convexity testing method for cluster analysis,"IEEE Trans. Syst., Man., Cybern., vol, SMC-10, no. 3, Mar. 1980.
[5] K. Fukunaga and L. O. Hostetler, "The estimation of the gradient of a density function, with applications in pattern recognition,"IEEE Trans. Inform. Theory, vol. IT-21, no. 1, pp. 32-40, Jan. 1975.
[6] W. L. Koontz, P. Narendra, and K. Fukunaga, "A graph theoretic approach to nonparametric cluster analysis,"IEEE Trans. Comput., vol. C-25, no. 9, pp. 936-944, Sept. 1976.
[7] W. L. Koontz and K. Fukunaga, "Asymptotic analysis of a non-parametric clustering technique,"IEEE Trans. Comput., vol. C-21, no. 9, pp. 967-974, Sept. 1972.
[8] J. O. Katz and F. J. Rohlf, "Function-point cluster analysis,"Systematic Zoology, vol. 22, pp. 295-301, 1973.
[9] W. L. Koontz and K. Fukunaga, "A nonparametric valley seeking technique for cluster analysis,"IEEE Trans. Comput., vol. C-21, no. 2, pp. 171-178, Feb. 1972.
[10] J. Kittler, "A locally sensitive method for cluster analysis,"Pattern Recognition, vol. 8, pp. 23-33, 1976.
[11] P. A. Devijver and J. Kittler,Pattern Recognition: A Statistical Approach. Englewood Cliffs, NJ: Prentice-Hall, 1982.
[12] E. Parzen, "On estimation of a probability density function and mode,"Ann. Math. Statist., vol. 33, pp. 1065-1076, Sept. 1962.
[13] J. V. Ryzin, "On strong consistency of density estimates,"Ann. Math. Statist., vol. 40, pp. 1765-1772, 1969.
[14] P. A. Nagin, "Segmentation using spatial context and feature space cluster labels," Univ. Massachusetts at Amherst, COINS Tech. Rep. 78-8, May 1978.
[15] A. Rosenfeld, R. A. Hummel, and S. W. Zucker, "Scene labeling by relaxation operations,"IEEE Trans. Syst., Man., Cybern., vol. SMC-6, no. 6, pp. 420-433, June 1976.
[16] S. W. Zucker, Y. G. Leclerc, and J. L. Mohammed, "Continuous relaxation and local maxima selection: Conditions for equivalence,"IEEE Trans. Pattern Anal. Machine Intell., vol. PAMI-3, no. 2, pp. 117-127, 1981.
[17] R. A. Hummel and S. W. Zucker, "On the foundations of relaxation labeling process,"IEEE Trans. Pattern Anal. Machine Intell., vol. PAMI-5, no. 3, pp. 267-286, 1983.
[18] A. Lev, S. W. Zucker, and A. Rosenfeld, "Iterative enhancement of noisy images,"IEEE Trans. Syst., Man., Cybern., vol. SMC-7, no. 6, pp. 435-442, June 1977.
[19] S. Peleg, "A new probabilistic relaxation scheme,"IEEE Trans. Pattern Anal. Machine Intell., vol. PAMI-2, no. 4, pp. 362-369, July 1980.
[20] A. J. Danker and A. Rosenfeld, "Blob detection by relaxation,"IEEE Trans. Pattern Anal. Machine Intell., vol. PAMI-3, no. 1, pp. 79- 92, Jan. 1981.
[21] A. Rosenfeld and R. C. Smith, "Thresholding using relaxation,"IEEE Trans. Pattern Anal. Machine Intell., vol. PAMI-3, no. 5, Sept. 1981.
[22] J. G. Postaire and C. Vasseur, "A fast algorithm for nonparametric probability density estimation,"IEEE Trans. Pattern Anal. Machine Intell., vol. PAMI-4, no. 6, pp. 663-666, 1982.
[23] T. Cacoullos, "Estimation of a multivariate density,"Ann. Inst. Statist., Math., vol. 18, pp. 179-189, 1965.
[24] F. R. Fromm and R. A. Northouse, "Some results on nonparametric clustering of large data problems,"Proc. 1st Joint Conf. Pattern Recognition, 1973, pp. 18-21.
[25] D. J. Eigen, F. R. Fromm, and R. A. Northouse, "Cluster analysis based on dimensional information with applications to feature selection and classification,"IEEE Trans. Syst., Man., Cybern., vol. SMC-4, pp. 284-294, May 1974.
[26] J. G. Postaire, "Une approche statistique unique pour l'analyse des mélanges et la détection des modes,"Rev. Statist. Appl., vol. 31, no. 4, pp. 17-36, 1983.
[27] A. H. Bock,Automatishe Klassifikation, Göttingen: Vandenhoeck&Rubrecht, 1974.
[28] J. A. Hartigan, "Clusters as modes," inProc. 1st Int. Symp. Data Analysis and Information, Versailles, France, 1977.
[29] J. A. Hartigan, "Distribution problems in clustering," inClassification&Clustering, J. Van Rysin, Ed. New York: Academic, 1977 pp. 45-71.
[30] B. Kopp, "Ein neuer Verfahren zur cluster analyse,"Biometrishe Meitshrift, vol. 18, pp. 473-476, 1976.
[31] A. Rosenfeld and A. Kak,Digital Picture Processing, New York: Academic, 1976.
[32] J. O. Eklundh and A. Rosenfeld, "Convergence properties of relaxation," Comput. Sci. Center, Univ. Maryland, Rep. TR-701, Oct. 1978.
[33] S. W. Zucker, E. V. Krishnamurthy, and R. L. Haar, "Relaxation processes for scene labeling: Convergence, speed, and stability,"IEEE Trans. Syst., Man., Cybern., vol. SMC-8, no. 1, pp. 41-48, Jan. 1978.
[34] G. Fekete, J. O. Eklundh, and A. Rosenfeld, "Relaxation: Evaluation and applications,"IEEE Trans. Pattern Anal. Machine Intell., vot. PAMI-3, no. 4, pp. 459-469, July 1981.
[35] J. G. Postaire and C. P. A. Vasseur, "An approximate solution to normal mixture identification with application to unsupervised pattern classification,"IEEE Trans. Pattern Anal. Machine Intell., vol. PAMI-3, no. 2, Mar. 1981.

Index Terms:
multidimensional data clustering; computerized pattern recognition; relaxation process; probability density function; label probabilities; mode detection; computerised pattern recognition; iterative methods; probability; relaxation theory
Citation:
A. Touzani, J.G. Postaire, "Mode Detection by Relaxation," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 10, no. 6, pp. 970-978, Nov. 1988, doi:10.1109/34.9120
Usage of this product signifies your acceptance of the Terms of Use.