This Article 
 Bibliographic References 
 Add to: 
A Maximum Variance Cluster Algorithm
September 2002 (vol. 24 no. 9)
pp. 1273-1280

Abstract—We present a partitional cluster algorithm that minimizes the sum-of-squared-error criterion while imposing a hard constraint on the cluster variance. Conceptually, hypothesized clusters act in parallel and cooperate with their neighboring clusters in order to minimize the criterion and to satisfy the variance constraint. In order to enable the demarcation of the cluster neighborhood without crucial parameters, we introduce the notion of foreign cluster samples. Finally, we demonstrate a new method for cluster tendency assessment based on varying the variance constraint parameter

[1] R. Adams and L. Bischof, “Seeded Region Growing,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 16, no. 6, pp. 641-647, June 1994.
[2] P. Andrey and P. Tarroux, “Unsupervised Image Segmentation Using a Distributed Genetic Algorithm,” Pattern Recognition, vol. 27, no. 5, pp. 659-673, 1994.
[3] P. Andrey and P. Tarroux, “Unsupervised Segmentation of Markov Random Field Modeled Textured Images Using Selectionist Relaxation,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 20, no. 3, pp. 252-262, Mar. 1998.
[4] P.J. Angeline and J.B. Pollack, “Competitive Environments Evolve Better Solutions for Complex Tasks,” Proc. Fifth Int'l Conf. Genetic Algorithms, pp. 264-270, 1993.
[5] G.P. Babu, N. Murty, and S.S. Keerthi, “A Stochastic Connectionist Approach for Global Optimization with Application to Pattern Clustering,” IEEE Trans. Systems, Man, and Cybernetics—Part B, vol. 30, no. 1, pp. 10-24, 2000.
[6] J.C. Bezdek and N.R. Pal, “Some New Indexes of Cluster Validity,” IEEE Trans. Systems, Man, and Cybernetics—Part B, vol. 28, no. 3, pp. 301-315, 1998.
[7] D.E. Brown and C.L. Huntley, “A Practical Application of Simulated Annealing to Clustering,” Pattern Recognition, vol. 25, no. 4, pp. 401-412, 1992.
[8] D.L. Davies and D.W. Bouldin, “A Cluster Separation Measure,” IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 1, no. 2, pp. 224-227, Apr. 1979.
[9] A.P. Dempster, N.M. Laird, and D.B. Rubin, “Maximum Likelihood from Incomplete Data via the EM Algorithm,” J. Royal Statistical Soc. B, vol. 39, pp. 1-38, 1977.
[10] A. di Nola, V. Loia, and A. Staiano, “Genetic-Based Spatial Clustering,” Proc. Ninth IEEE Int'l Conf. Fuzzy Systems, pp. 953-956, 2000.
[11] J.C. Dunn, “Well Separated Clusters and Optimal Fuzzy Partitions,” J. Cybernetics, vol. 4, pp. 95-104, 1974.
[12] K.C. Gowda and G. Krishna, “Agglomerative Clustering Using the Concept of Mutual Nearest Neighborhood,” Pattern Recognition, vol. 10, pp. 105-112, 1978.
[13] L.O. Hall, I.B. Özyurt, and J.C. Bezdek, “Clustering with a Genetically Optimized Approach,” IEEE Trans. Evolutionary Computation, vol. 3, no. 2, pp. 103-112, July 1999.
[14] J.H. Holland, Adaptation in Natural and Artificial Systems. Univ. of Michigan Press, 1975.
[15] S.L. Horowitz and T. Pavlidis, “Picture Segmentation by a Tree Traversal Algorithm,” J. ACM, vol. 23, no. 2, pp. 368-388, 1976.
[16] L.J. Hubert and P. Arabie, “Comparing Partitions,” J. Classification, vol. 2, pp. 193-218, 1985.
[17] S. Ingrassia, “A Comparison between Simulated Annealing and the EM Algorithms in Normal Mixtures Decompositions” Statistics and Computing, vol. 2, pp. 203-211, 1992.
[18] A.K. Jain and R.C. Dubes, Algorithms for Clustering Data. Englewood Cliffs, N.J.: Prentice Hall, 1988.
[19] R.A. Jarvis and E.A. Patrick, “Clustering Using a Similarity Measure Based on Shared Near Neighbors,” IEEE Trans. Computers, vol. 22, pp. 1025-1034, 1973.
[20] R.W. Klein and R.C. Dubes, “Experiments in Projection and Clustering by Simulated Annealing,” Pattern Recognition, vol. 22, no. 2, pp. 213-220, 1989.
[21] K. Krishna and M.N. Murty, “Genetic K-Means Algorithm,” IEEE Trans. Systems, Man, and Cybernetics—Part B, vol. 29, no. 3, pp. 433-439, June 1999.
[22] T. Van Le, “Evolutionary Fuzzy Clustering,” Proc. IEEE Int'l Conf. Evolutionary Computation, vol. 2, pp. 753-758, Oct. 1995.
[23] J. MacQueen, “Some Methods for Classification and Analysis of Multivariate Observations,” Proc. Fifth Berkeley Symp. Math. Statistics and Probability, L.M. Le Cam and J. Neyman, eds., vol. 1, pp. 281-297, 1967.
[24] E.J. Pauwels and G. Frederix, “Nonparametric Clustering for Image Segmentation and Grouping,” Image Understanding, vol. 75, no. 1, pp. 73-85, 2000.
[25] S.Z. Selim and K. Alsultan, “A Simulated Annealing Algorithm for the Clustering Problem,” Pattern Recognition, vol. 24, no. 10, pp. 1003-1008, 1991.
[26] S. Theodoridis and K. Koutroumbas, Pattern Recognition. London: Academic Press, 1999.
[27] D.M. Titterington, A.F.M. Smith, and U.E. Makov, Statistical Analysis of Finite Mixture Distributions. New York: John Wiley and Sons, 1990.
[28] C.J. Veenman, M.J.T. Reinders, and E. Backer, “A Cellular Coevolutionary Algorithm for Image Segmentation,” IEEE Trans. Image Processing, Submitted 2001.
[29] L. Zhao, Y. Tsujimura, and M. Gen, “Genetic Algorithm for Fuzzy Clustering,” Proc. IEEE Int'l Conf. Evolutionary Computation, pp. 716-719, 1996.

Index Terms:
Cluster analysis, partitional clustering, cluster tendency assessment, cluster validity.
Cor J. Veenman, Marcel J.T. Reinders, Eric Backer, "A Maximum Variance Cluster Algorithm," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 24, no. 9, pp. 1273-1280, Sept. 2002, doi:10.1109/TPAMI.2002.1033218
Usage of this product signifies your acceptance of the Terms of Use.