The Community for Technology Leaders
RSS Icon
Hong Kong
Dec. 18, 2006 to Dec. 22, 2006
ISBN: 0-7695-2701-7
pp: 149-158
Matt Culver , University of Nebraska, USA
Deng Kun , University of Nebraska, USA
Stephen Scott , University of Nebraska, USA
In active learning, a machine learning algorithmis given an unlabeled set of examples U, and is allowed to request labels for a relatively small subset of U to use for training. The goal is then to judiciously choose which examples in U to have labeled in order to optimize some performance criterion, e.g. classification accuracy. We study how active learning affects AUC. We examine two existing algorithms from the literature and present our own active learning algorithms designed to maximize the AUC of the hypothesis. One of our algorithms was consistently the top performer, and Closest Sampling from the literature often came in second behind it. When good posterior probability estimates were available, our heuristics were by far the best.
Matt Culver, Deng Kun, Stephen Scott, "Active Learning to Maximize Area Under the ROC Curve", ICDM, 2006, Sixth International Conference on Data Mining (ICDM'06), Sixth International Conference on Data Mining (ICDM'06) 2006, pp. 149-158, doi:10.1109/ICDM.2006.12
32 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool