The Community for Technology Leaders
Green Image
Issue No. 11 - November (2011 vol. 23)
ISSN: 1041-4347
pp: 1601-1618
Maria Carolina Monard , Universidade de São Paulo (USP), São Carlos
Gustavo E.A.P.A. Batista , Universidade de São Paulo (USP), São Carlos
Ronaldo C. Prati , Universidade Federal do ABC (UFABC), Santo André
ABSTRACT
Predictive performance evaluation is a fundamental issue in design, development, and deployment of classification systems. As predictive performance evaluation is a multidimensional problem, single scalar summaries such as error rate, although quite convenient due to its simplicity, can seldom evaluate all the aspects that a complete and reliable evaluation must consider. Due to this, various graphical performance evaluation methods are increasingly drawing the attention of machine learning, data mining, and pattern recognition communities. The main advantage of these types of methods resides in their ability to depict the trade-offs between evaluation aspects in a multidimensional space rather than reducing these aspects to an arbitrarily chosen (and often biased) single scalar measure. Furthermore, to appropriately select a suitable graphical method for a given task, it is crucial to identify its strengths and weaknesses. This paper surveys various graphical methods often used for predictive performance evaluation. By presenting these methods in the same framework, we hope this paper may shed some light on deciding which methods are more suitable to use in different situations.
INDEX TERMS
Machine learning, data mining, performance evaluation, ROC curves, cost curves, lift graphs.
CITATION
Maria Carolina Monard, Gustavo E.A.P.A. Batista, Ronaldo C. Prati, "A Survey on Graphical Methods for Classification Predictive Performance Evaluation", IEEE Transactions on Knowledge & Data Engineering, vol. 23, no. , pp. 1601-1618, November 2011, doi:10.1109/TKDE.2011.59
106 ms
(Ver 3.1 (10032016))