The Community for Technology Leaders
Green Image
Issue No. 03 - March (2011 vol. 23)
ISSN: 1041-4347
pp: 335-349
Jung-Yi Jiang , National Sun Yat-Sen University, Taiwan
Ren-Jia Liou , National Sun Yat-Sen University, Taiwan
Shie-Jue Lee , National Sun Yat-Sen University, Taiwan
ABSTRACT
Feature clustering is a powerful method to reduce the dimensionality of feature vectors for text classification. In this paper, we propose a fuzzy similarity-based self-constructing algorithm for feature clustering. The words in the feature vector of a document set are grouped into clusters, based on similarity test. Words that are similar to each other are grouped into the same cluster. Each cluster is characterized by a membership function with statistical mean and deviation. When all the words have been fed in, a desired number of clusters are formed automatically. We then have one extracted feature for each cluster. The extracted feature, corresponding to a cluster, is a weighted combination of the words contained in the cluster. By this algorithm, the derived membership functions match closely with and describe properly the real distribution of the training data. Besides, the user need not specify the number of extracted features in advance, and trial-and-error for determining the appropriate number of extracted features can then be avoided. Experimental results show that our method can run faster and obtain better extracted features than other methods.
INDEX TERMS
Fuzzy similarity, feature clustering, feature extraction, feature reduction, text classification.
CITATION
Jung-Yi Jiang, Ren-Jia Liou, Shie-Jue Lee, "A Fuzzy Self-Constructing Feature Clustering Algorithm for Text Classification", IEEE Transactions on Knowledge & Data Engineering, vol. 23, no. , pp. 335-349, March 2011, doi:10.1109/TKDE.2010.122
98 ms
(Ver )