The Community for Technology Leaders
Sixth International Conference on Data Mining (ICDM'06) (2006)
Hong Kong
Dec. 18, 2006 to Dec. 22, 2006
ISSN: 1550-4786
ISBN: 0-7695-2701-9
pp: 869-873
Gabriel Pui Cheong Fung , The Chinese University of Hong Kong, Hong Kong
Jeffrey Xu Yu , The Chinese University of Hong Kong, Hong Kong
Haixun Wang , IBM T.J. Watson Research Center, USA
David W. Cheung , The University of Hong Kong, Hong Kong
Huan Liu , Arizona State University, USA
ABSTRACT
This paper studies the problem of constructing an effective heterogeneous ensemble classifier for text classification. One major challenge of this problem is to formulate a good combination function, which combines the decisions of the individual classifiers in the ensemble. We show that the classification performance is affected by three weight components and they should be included in deriving an effective combination function. They are: (1) Global effectiveness, which measures the effectiveness of a member classifier in classifying a set of unseen documents; (2) Local effectiveness, which measures the effectiveness of a member classifier in classifying the particular domain of an unseen document; and (3) Decision confidence, which describes how confident a classifier is when making a decision when classifying a specific unseen document. We propose a new balanced combination function, called Dynamic Classifier Weighting (DCW), that incorporates the afore-mentioned three components. The empirical study demonstrates that the new combination function is highly effective for text classification.
INDEX TERMS
null
CITATION

H. Liu, H. Wang, G. P. Fung, D. W. Cheung and J. X. Yu, "A Balanced Ensemble Approach to Weighting Classifiers for Text Classification," Sixth International Conference on Data Mining (ICDM'06)(ICDM), Hong Kong, 2006, pp. 869-873.
doi:10.1109/ICDM.2006.2
99 ms
(Ver 3.3 (11022016))