Publication 2013 Issue No. 6 - June Abstract - Efficient Optimization of Performance Measures by Classifier Adaptation
 This Article Share Bibliographic References Add to: Digg Furl Spurl Blink Simpy Google Del.icio.us Y!MyWeb Search Similar Articles Articles by Nan Li Articles by Ivor W. Tsang Articles by Zhi-Hua Zhou
Efficient Optimization of Performance Measures by Classifier Adaptation
June 2013 (vol. 35 no. 6)
pp. 1370-1382
 ASCII Text x Nan Li, Ivor W. Tsang, Zhi-Hua Zhou, "Efficient Optimization of Performance Measures by Classifier Adaptation," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 35, no. 6, pp. 1370-1382, June, 2013.
 BibTex x @article{ 10.1109/TPAMI.2012.172,author = {Nan Li and Ivor W. Tsang and Zhi-Hua Zhou},title = {Efficient Optimization of Performance Measures by Classifier Adaptation},journal ={IEEE Transactions on Pattern Analysis and Machine Intelligence},volume = {35},number = {6},issn = {0162-8828},year = {2013},pages = {1370-1382},doi = {http://doi.ieeecomputersociety.org/10.1109/TPAMI.2012.172},publisher = {IEEE Computer Society},address = {Los Alamitos, CA, USA},}
 RefWorks Procite/RefMan/Endnote x TY - JOURJO - IEEE Transactions on Pattern Analysis and Machine IntelligenceTI - Efficient Optimization of Performance Measures by Classifier AdaptationIS - 6SN - 0162-8828SP1370EP1382EPD - 1370-1382A1 - Nan Li, A1 - Ivor W. Tsang, A1 - Zhi-Hua Zhou, PY - 2013KW - Loss measurementKW - Algorithm design and analysisKW - TrainingKW - VectorsKW - Upper boundKW - KernelKW - Educational institutionsKW - curriculum learningKW - Optimize performance measuresKW - classifier adaptationKW - ensemble learningVL - 35JA - IEEE Transactions on Pattern Analysis and Machine IntelligenceER -
Nan Li, Nanjing University, Nanjing and Soochow University, Suzhou
Ivor W. Tsang, Nanyang Technological University, Singapore
Zhi-Hua Zhou, Nanjing University, Nanjing
In practical applications, machine learning algorithms are often needed to learn classifiers that optimize domain specific performance measures. Previously, the research has focused on learning the needed classifier in isolation, yet learning nonlinear classifier for nonlinear and nonsmooth performance measures is still hard. In this paper, rather than learning the needed classifier by optimizing specific performance measure directly, we circumvent this problem by proposing a novel two-step approach called CAPO, namely, to first train nonlinear auxiliary classifiers with existing learning methods and then to adapt auxiliary classifiers for specific performance measures. In the first step, auxiliary classifiers can be obtained efficiently by taking off-the-shelf learning algorithms. For the second step, we show that the classifier adaptation problem can be reduced to a quadratic program problem, which is similar to linear $({\rm SVM}^{\rm perf})$ and can be efficiently solved. By exploiting nonlinear auxiliary classifiers, CAPO can generate nonlinear classifier which optimizes a large variety of performance measures, including all the performance measures based on the contingency table and AUC, while keeping high computational efficiency. Empirical studies show that CAPO is effective and of high computational efficiency, and it is even more efficient than linear $({\rm SVM}^{\rm perf})$.
Index Terms:
Loss measurement,Algorithm design and analysis,Training,Vectors,Upper bound,Kernel,Educational institutions,curriculum learning,Optimize performance measures,classifier adaptation,ensemble learning
Citation:
Nan Li, Ivor W. Tsang, Zhi-Hua Zhou, "Efficient Optimization of Performance Measures by Classifier Adaptation," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 35, no. 6, pp. 1370-1382, June 2013, doi:10.1109/TPAMI.2012.172