The Community for Technology Leaders
2013 IEEE 13th International Conference on Data Mining (2011)
Vancouver, Canada
Dec. 11, 2011 to Dec. 14, 2011
ISSN: 1550-4786
ISBN: 978-0-7695-4408-3
pp: 754-763
ABSTRACT
Class imbalance (i.e., scenarios in which classes are unequally represented in the training data) occurs in many real-world learning tasks. Yet despite its practical importance, there is no established theory of class imbalance, and existing methods for handling it are therefore not well motivated. In this work, we approach the problem of imbalance from a probabilistic perspective, and from this vantage identify dataset characteristics (such as dimensionality, sparsity, etc.) that exacerbate the problem. Motivated by this theory, we advocate the approach of bagging an ensemble of classifiers induced over balanced bootstrap training samples, arguing that this strategy will often succeed where others fail. Thus in addition to providing a theoretical understanding of class imbalance, corroborated by our experiments on both simulated and real datasets, we provide practical guidance for the data mining practitioner working with imbalanced data.
INDEX TERMS
Classification, class imbalance
CITATION
Kevin Small, Carla E. Brodley, Thomas A. Trikalinos, Byron C. Wallace, "Class Imbalance, Redux", 2013 IEEE 13th International Conference on Data Mining, vol. 00, no. , pp. 754-763, 2011, doi:10.1109/ICDM.2011.33
174 ms
(Ver 3.3 (11022016))