The Community for Technology Leaders
RSS Icon
Subscribe
Issue No.10 - October (1989 vol.11)
pp: 1087-1101
ABSTRACT
<p>An expression for expected classifier performance previously derived by the authors is applied to a variety of error estimation methods and a unified and comprehensive approach to the analysis of classifier performance is presented. After the error expression is introduced, it is applied to three cases: (1) a given classifier and a finite test set; (2) given test distributions a finite design set; and (3) finite and independent design and test sets. For all cases, the expected values and variances of the classifier errors are presented. Although the study of Case 1 does not produce any new results, it is important to confirm that the proposed approach produces the known results, and also to show how these results are modified when the design set becomes finite, as in Cases 2 and 3. The error expression is used to compute the bias between the leave-one-out and resubstitution errors for quadratic classifiers. The effect of outliers in design samples on the classification error is discussed. Finally, the theoretical analysis of the bootstrap method is presented for quadratic classifiers.</p>
INDEX TERMS
pattern recognition; performance analysis; error estimation; classifier; finite test set; error expression; error analysis; estimation theory; pattern recognition
CITATION
K. Fukunaga, R.R. Hayes, "Estimation of Classifier Performance", IEEE Transactions on Pattern Analysis & Machine Intelligence, vol.11, no. 10, pp. 1087-1101, October 1989, doi:10.1109/34.42839
20 ms
(Ver 2.0)

Marketing Automation Platform Marketing Automation Tool