This Article 
   
 Share 
   
 Bibliographic References 
   
 Add to: 
 
Digg
Furl
Spurl
Blink
Simpy
Google
Del.icio.us
Y!MyWeb
 
 Search 
   
2012 IEEE 12th International Conference on Data Mining Workshops
Effective Text Classification by a Supervised Feature Selection Approach
Brussels, Belgium Belgium
December 10-December 10
ISBN: 978-1-4673-5164-5
The high dimensionality of data is a great challenge for effective text classification. Each document in a document corpus contains many irrelevant and noisy information which eventually reduces the efficiency of text classification. Automatic feature selection methods are extremely important to handle the high dimensionality of data for effective text classification. Feature selection in text classification focuses on identifying relevant information without affecting the accuracy of the classifier. Several feature selection methods have been proposed to improve the classification accuracy by reducing the original feature space. To improve the performance of text classification a new supervised feature selection approach has been proposed which develops a similarity between a term and a class. In this way every term will generate a score based on their similarity with all the classes and then all the terms will be ranked accordingly. The experimental results are presented on several TREC and Reuter data sets using knn classifier. The performances of the classifiers are compared using precision, recall, f-measure and classification accuracy. The proposed term selection approach is compared with document frequency thresholding, information gain, mutual information and chi square statistic. The empirical studies have shown that the proposed method performs significantly better than the other methods.
Index Terms:
Training,Vocabulary,Accuracy,Frequency measurement,Mutual information,Complexity theory,Equations,Text Classification,Feature Selection
Citation:
Tanmay Basu, C.A. Murthy, "Effective Text Classification by a Supervised Feature Selection Approach," icdmw, pp.918-925, 2012 IEEE 12th International Conference on Data Mining Workshops, 2012
Usage of this product signifies your acceptance of the Terms of Use.