Brussels, Belgium Belgium
Dec. 10, 2012 to Dec. 10, 2012
In the context of the class imbalance problem, most existing approaches require the knowledge of costs for reaching the reasonable classification results. If the costs are unknown, some approaches can not work properly. Moreover, to our best knowledge, none of the cost-sensitive approaches is able to process the abstaining classifications when costs are unknown for errors and rejects. Therefore, the challenge above forms the motivation of this work. Based on information theory, we propose a novel cost-free learning approach which targets the maximization of normalized mutual information between the target outputs and the decision outputs of classifiers. Using the approach, we can deal with classifications with/without rejections when no cost terms are given. While the degree of class imbalance is changing, the proposed approach is able to balance the errors and rejects accordingly and automatically. Another advantage of the approach is its ability of deriving optimal reject thresholds for abstaining classification and the "equivalent" costs for binary probabilistic classification. Numerical investigation is made on several benchmark data sets and the classification results confirm the unique feature of the approach for overcoming the challenge.
Machine learning, Mutual information, Error analysis, Vectors, Accuracy, Equations, Mathematical model, imbalanced learning; classification; reject option; cost-free learning; mutual information
Xiaowan Zhang, Bao-Gang Hu, "Learning in the Class Imbalance Problem When Costs are Unknown for Errors and Rejects", ICDMW, 2012, 2013 IEEE 13th International Conference on Data Mining Workshops, 2013 IEEE 13th International Conference on Data Mining Workshops 2012, pp. 194-201, doi:10.1109/ICDMW.2012.167